00000001:02000400:3.0F:1790740136.465203:0:2959:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg358-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1790740159.372063:0:3181:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg358-server.virtnet: executing load_modules_local 00000001:01000000:0.0:1790740162.325103:0:3243:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 792 MB/s 00000001:01000000:2.0F:1790740162.574894:0:3243:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 763 MB/s 00000001:01000000:1.0F:1790740162.824937:0:3243:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3719 MB/s 00000020:02000000:0.0:1790740163.859519:0:3272:0:(class_obd.c:846:obdclass_init()) Lustre: Build Version: 2.17.59_3_g21e240e 00000400:02000000:0.0:1790740164.999292:0:3287:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.203.158@tcp [8/256/0/180] 00008000:02000000:0.0:1790740168.636027:0:3437:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1790740217.638488:0:5241:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg358-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1790740228.324653:0:5824:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1790740228.324657:0:5824:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1790740228.324790:0:5824:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000926e8a37 00000080:02000400:3.0:1790740228.324802:0:5824:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' or install '{/usr}/sbin/mount.lustre_tgt' 00000020:01000004:3.0:1790740228.332384:0:5824:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1790740228.332397:0:5824:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1790740228.332438:0:5824:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000001fd07bff) 00000020:00000080:3.0:1790740228.332460:0:5824:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1790740228.352242:0:5824:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1790740228.352971:0:5824:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1790740228.372541:0:5824:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1790740228.372621:0:5824:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1790740228.372644:0:5824:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1790740228.372697:0:5824:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1790740228.372726:0:5824:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1790740228.373073:0:5824:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1790740228.373082:0:5824:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1790740228.373094:0:5824:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc6b31a1b598e98e4 00000020:01000004:1.0:1790740228.373101:0:5824:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1790740228.373105:0:5824:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1790740228.373109:0:5824:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000926e8a37 from MGS 00000020:01000004:1.0:1790740228.373113:0:5824:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1790740228.373128:0:5824:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000042b89271) 00000020:00000080:1.0:1790740228.373139:0:5824:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1790740228.373196:0:5824:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000926e8a37 from MGS, refs=2 00080000:01000000:1.0:1790740228.373201:0:5824:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1790740228.373206:0:5824:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc6b31a1b598e98f2 00000100:00100000:1.0:1790740228.373370:0:5824:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1790740228.373505:0:5824:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1790740228.373514:0:5824:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1790740228.374191:0:5824:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1790740228.374197:0:5824:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1790740228.375064:0:5824:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790740228.375224:0:5824:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1790740228.375230:0:5824:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1790740228.375690:0:5824:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1790740228.375698:0:5824:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1790740228.376907:0:5824:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1790740228.376916:0:5824:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1790740228.377727:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740228.377731:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740228.377733:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740228.378025:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740228.378027:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740228.378029:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740228.378438:0:5824:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1790740228.380294:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1790740228.627699:0:5824:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 4591 MB/s 00000001:01000000:3.0:1790740228.877664:0:5824:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 5707 MB/s 00000001:01000000:2.0:1790740229.127861:0:5824:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 995 MB/s 00000001:01000000:2.0:1790740229.378116:0:5824:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 911 MB/s 00080000:10000000:2.0:1790740229.386005:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:2.0:1790740229.398952:0:5824:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1790740229.398971:0:5824:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1790740229.398974:0:5824:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1790740229.399564:0:5834:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1790740229.399664:0:5824:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1790740229.399718:0:5824:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1790740229.399905:0:5824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1790740229.399927:0:5824:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1790740229.400313:0:5824:0:(service.c:173:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790740229.400462:0:5824:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1790740229.400467:0:5824:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1790740229.401210:0:5824:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1790740229.401224:0:5824:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1790740229.401765:0:5824:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1790740229.401771:0:5824:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1790740229.402342:0:5824:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1790740229.402362:0:5824:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.158@tcp' 00000020:01000004:3.0:1790740229.402375:0:5824:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1790740229.402427:0:5824:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.158@tcp (typ=mgc) 00000020:00000080:3.0:1790740229.402441:0:5824:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.158@tcp (000000003421203f) 00000020:00000080:3.0:1790740229.402462:0:5824:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1790740229.402547:0:5824:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000117cbae5@MGC192.168.203.158@tcp: add connection 192.168.203.158@tcp at head 00000100:00080000:2.0:1790740229.402770:0:5838:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:3.0:1790740229.402964:0:5824:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.158@tcp-0 is initialized 00000040:01000000:3.0:1790740229.402969:0:5824:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.158@tcp ctxt 1 is initialized 10000000:01000000:1.0:1790740229.408757:0:5841:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1790740229.408814:0:5824:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.158@tcp (uuid 10ce3df1-3f26-4bb4-b4c3-d740981d121e) 00000020:00000080:1.0:1790740229.408835:0:5824:0:(genops.c:1384:class_connect()) connect: client 10ce3df1-3f26-4bb4-b4c3-d740981d121e, cookie 0xc6b31a1b598e9900 00000100:00080000:1.0:1790740229.408846:0:5824:0:(import.c:545:import_select_connection()) MGC192.168.203.158@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790740229.408853:0:5824:0:(import.c:666:import_select_connection()) MGC192.168.203.158@tcp: import 00000000117cbae5 using connection 192.168.203.158@tcp/0@lo 00000100:00100000:1.0:1790740229.408893:0:5824:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000073b1be23 x1877727158206592/t0(0) o250->MGC192.168.203.158@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790740229.408967:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000073b1be23 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3302:1877727158206592:0@lo:250: 00000100:00100000:1.0:1790740229.409023:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740229.409066:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158206592 00000100:00100000:3.0:1790740229.409075:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158206592 00000100:00100000:3.0:1790740229.409109:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790740229.409117:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000006a7b95ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3302:x1877727158206592:12345-0@lo:250: 00010000:00080000:3.0:1790740229.409150:0:5835:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 10ce3df1-3f26-4bb4-b4c3-d740981d121e@0@lo t0 exp 0000000000000000 cur 145 last 0 00000020:00000080:3.0:1790740229.409176:0:5835:0:(genops.c:1384:class_connect()) connect: client 10ce3df1-3f26-4bb4-b4c3-d740981d121e, cookie 0xc6b31a1b598e9907 00000100:00080000:1.0:1790740229.411189:0:5824:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 10ce3df1-3f26-4bb4-b4c3-d740981d121e->MGS 00000020:01000004:1.0:1790740229.411217:0:5824:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1790740229.411244:0:5824:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000100:00080000:3.0:1790740229.411260:0:5835:0:(import.c:65:import_set_state_nolock()) 00000000453600d4 : changing import state from RECOVER to FULL 00000020:00000080:1.0:1790740229.411261:0:5824:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000478790b8) 00000020:00000080:1.0:1790740229.411277:0:5824:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1790740229.411374:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000006a7b95ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+5:3302:x1877727158206592:12345-0@lo:250: Request processed in 2257us (2351us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740229.411383:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790740229.411389:0:3302:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.158@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1790740229.411410:0:3302:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.158@tcp: connect to target with instance 0 00000100:00080000:1.0:1790740229.411417:0:3302:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.158@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1790740229.411422:0:3302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1790740229.411425:0:3302:0:(import.c:65:import_set_state_nolock()) 00000000117cbae5 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1790740229.411428:0:3302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1790740229.411431:0:3302:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1790740229.411435:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000073b1be23 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3302:1877727158206592:0@lo:250: 00010000:00010000:3.0:1790740229.431569:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740229.445096:0:5824:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790740229.445314:0:5824:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1790740229.445322:0:5824:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1790740229.446325:0:5824:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1790740229.446334:0:5824:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1790740229.447245:0:5824:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1790740229.447252:0:5824:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1790740229.449057:0:5824:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790740229.449232:0:5824:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1790740229.449242:0:5824:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1790740229.449871:0:5824:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1790740229.449878:0:5824:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1790740229.514989:0:5824:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790740229.515185:0:5824:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1790740229.515191:0:5824:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1790740229.517024:0:5824:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1790740229.517045:0:5824:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1790740229.517997:0:5824:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790740229.518173:0:5824:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1790740229.518178:0:5824:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1790740229.519257:0:5824:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790740229.519266:0:5824:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1790740229.520246:0:5824:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790740229.520824:0:5824:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1790740229.520831:0:5824:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1790740229.521313:0:5824:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790740229.521320:0:5824:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1790740229.522562:0:5824:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790740229.522884:0:5824:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1790740229.522898:0:5824:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1790740229.524073:0:5824:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1790740229.524084:0:5824:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1790740229.562157:0:5824:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790740229.568874:0:5824:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1790740229.568884:0:5824:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1790740229.572537:0:5824:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1790740229.572561:0:5824:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1790740229.575357:0:5824:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1790740229.575382:0:5824:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1790740229.581742:0:5824:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1790740229.581781:0:5824:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1790740229.581788:0:5824:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.158@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1790740229.581939:0:5824:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.158@tcp ctxt 0 is initialized 00000020:01000004:0.0:1790740229.581970:0:5824:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.158@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1790740229.581985:0:5824:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1790740229.581987:0:5824:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790740229.581989:0:5824:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790740229.581990:0:5824:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790740229.581991:0:5824:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790740229.581993:0:5824:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790740229.581994:0:5824:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790740229.581995:0:5824:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790740229.581997:0:5824:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790740229.581998:0:5824:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790740229.582000:0:5824:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790740229.582001:0:5824:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790740229.582003:0:5824:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1790740229.582006:0:5824:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790740229.582007:0:5824:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790740229.582008:0:5824:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790740229.582009:0:5824:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790740229.582010:0:5824:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790740229.582011:0:5824:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790740229.582012:0:5824:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790740229.582014:0:5824:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790740229.582015:0:5824:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790740229.582016:0:5824:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790740229.582017:0:5824:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790740229.582018:0:5824:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790740229.582050:0:5824:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1790740229.582066:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000014402c6e pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5824:1877727158206720:0@lo:253: 00000100:00100000:0.0:1790740229.582143:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740229.582185:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set 00000000646462d7 going to sleep for 11 seconds 00000100:00100000:3.0:1790740229.582455:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158206720 00000100:00100000:3.0:1790740229.582464:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158206720 00000100:00100000:3.0:1790740229.582547:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790740229.582563:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000a35a8f46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+5:5824:x1877727158206720:12345-0@lo:253: 20000000:01000000:3.0:1790740229.582626:0:5837:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1790740229.582629:0:5837:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1790740229.593017:0:5858:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1790740229.593152:0:5837:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1790740229.593447:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790740229.596298:0:5859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1790740229.596856:0:5837:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1790740229.596861:0:5837:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1790740229.596866:0:5837:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1790740229.596869:0:5837:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1790740229.596886:0:5837:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1790740229.597317:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790740229.597546:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1790740229.597559:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1790740229.597780:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1790740229.597837:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1790740229.597878:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1790740229.597967:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1790740229.597975:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1790740229.598020:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1790740229.598029:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1790740229.598060:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1790740229.598068:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1790740229.598111:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1790740229.598172:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1790740229.598203:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1790740229.598208:0:5837:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1790740229.598221:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790740229.598423:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1790740229.598432:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1790740229.598466:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1790740229.598502:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1790740229.598567:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1790740229.598963:0:5837:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1790740229.599044:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1790740229.599053:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1790740229.599119:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1790740229.599157:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1790740229.599190:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1790740229.599201:0:5837:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1790740229.599286:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1790740229.599295:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1790740229.599324:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1790740229.599355:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1790740229.599522:0:5837:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1790740229.599635:0:5837:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1790740229.599645:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1790740229.601236:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1790740229.601485:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1790740229.601526:0:5837:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.158@tcp for mdt 20000000:01000000:3.0:1790740229.601534:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.158@tcp (null) (null) (null) 00000040:00080000:3.0:1790740229.601594:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1790740229.601604:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1790740229.601647:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1790740229.601655:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.158@tcp (null) (null) 00000040:00080000:3.0:1790740229.601698:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1790740229.602194:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1790740229.602241:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1790740229.602277:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1790740229.602356:0:5837:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1790740229.602359:0:5837:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1790740229.602362:0:5837:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1790740229.602376:0:5837:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1790740229.602379:0:5837:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1790740229.602408:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1790740229.602411:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1790740229.603273:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1790740229.603885:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1790740229.603939:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1790740229.603975:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:0.0:1790740229.603990:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1790740229.603993:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1790740229.606283:0:5862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1790740229.606863:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1790740229.606914:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1790740229.607053:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:0.0:1790740229.607068:0:5837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790740229.607071:0:5837:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1790740229.607076:0:5837:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1790740229.607078:0:5837:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1790740229.607083:0:5837:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1790740229.607090:0:5837:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1790740229.611033:0:5863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:3.0:1790740229.611137:0:5837:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1790740229.621382:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1790740229.621441:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1790740229.621532:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1790740229.621555:0:5837:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1790740229.621714:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000d09c8e22/0xc6b31a1b598e9915 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740229.621733:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d09c8e22/0xc6b31a1b598e9915 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740229.621743:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d09c8e22/0xc6b31a1b598e9915 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740229.621749:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d09c8e22/0xc6b31a1b598e9915 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740229.621768:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000d09c8e22/0xc6b31a1b598e9915 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740229.621774:0:5837:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000d09c8e22/0xc6b31a1b598e9915 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740229.621781:0:5837:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock 00000000d09c8e22 already unused, calling callback (000000002702e643) 00010000:00010000:3.0:1790740229.621784:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000d09c8e22/0xc6b31a1b598e9915 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740229.621792:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000d09c8e22/0xc6b31a1b598e9915 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740229.621805:0:5837:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000d09c8e22/0xc6b31a1b598e9915 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740229.621813:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000d09c8e22/0xc6b31a1b598e9915 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740229.621819:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d09c8e22/0xc6b31a1b598e9915 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790740229.621837:0:5837:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1790740229.896441:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000014402c6e pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5824:1877727158206720:0@lo:253: 00000100:00100000:2.0:1790740229.896451:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000a35a8f46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+5:5824:x1877727158206720:12345-0@lo:253: Request processed in 313843us (314255us total) trans 0 rc 0/0 10000000:01000000:0.0:1790740229.896462:0:5824:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000100:00100000:2.0:1790740229.896466:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000020:01000004:0.0:1790740229.896468:0:5824:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790740229.896471:0:5824:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790740229.896479:0:5824:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790740229.896480:0:5824:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1790740229.896482:0:5824:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790740229.896483:0:5824:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790740229.896485:0:5824:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790740229.896486:0:5824:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790740229.896488:0:5824:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1790740229.896489:0:5824:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790740229.896491:0:5824:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1790740229.896509:0:5824:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000926e8a37 from lustre-MDT0000 10000000:01000000:0.0:1790740229.896544:0:5824:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1790740229.896547:0:5824:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1790740229.896551:0:5824:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8f0d87f419c0 10000000:01000000:0.0:1790740229.896555:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790740229.896562:0:5824:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8f0d87f419c0 from 1 10000000:01000000:0.0:1790740229.896564:0:5824:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1790740229.896633:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: 00000000870d6c11/0xc6b31a1b598e991c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740229.896644:0:5824:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.158@tcp lock: 00000000870d6c11/0xc6b31a1b598e991c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740229.896662:0:5824:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.158@tcp lock: 00000000870d6c11/0xc6b31a1b598e991c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740229.896679:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000014402c6e pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5824:1877727158206848:0@lo:101: 00000100:00100000:0.0:1790740229.896712:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740229.896769:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e54d7a9f going to sleep for 11 seconds 00000100:00100000:3.0:1790740229.896823:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158206848 00000100:00100000:3.0:1790740229.896829:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158206848 00000100:00100000:3.0:1790740229.896866:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790740229.896874:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000008e5c4ccb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+5:5824:x1877727158206848:12345-0@lo:101: 00010000:00010000:3.0:1790740229.896886:0:5835:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740229.896898:0:5835:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d09c8e22/0xc6b31a1b598e9923 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b31a1b598e991c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740229.896924:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d09c8e22/0xc6b31a1b598e9923 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b31a1b598e991c expref: 6 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740229.896933:0:5835:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d09c8e22/0xc6b31a1b598e9923 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e991c expref: 6 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740229.896940:0:5835:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d09c8e22, rc 0) 00000100:00100000:3.0:1790740229.896975:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000008e5c4ccb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+6:5824:x1877727158206848:12345-0@lo:101: Request processed in 103us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740229.896981:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790740229.897106:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000014402c6e pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5824:1877727158206848:0@lo:101: 00010000:00010000:1.0:1790740229.897117:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.158@tcp lock: 00000000870d6c11/0xc6b31a1b598e991c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9923 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740229.897124:0:5824:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.158@tcp lock: 00000000870d6c11/0xc6b31a1b598e991c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598e9923 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740229.897163:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000073b1be23 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5824:1877727158206976:0@lo:501: 00000100:00100000:1.0:1790740229.897187:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740229.897237:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d668d750 going to sleep for 11 seconds 00000100:00100000:2.0:1790740229.897314:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158206976 00000100:00100000:2.0:1790740229.897319:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158206976 00000100:00100000:2.0:1790740229.897357:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790740229.897363:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000008007c943 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+6:5824:x1877727158206976:12345-0@lo:501: 00000100:00100000:2.0:1790740229.897626:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000008007c943 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+6:5824:x1877727158206976:12345-0@lo:501: Request processed in 264us (439us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790740229.897634:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790740229.897717:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000073b1be23 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5824:1877727158206976:0@lo:501: 10000000:01000000:1.0:1790740229.897737:0:5824:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.158@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1790740229.897784:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: 00000000870d6c11/0xc6b31a1b598e991c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9923 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740229.897793:0:5824:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.158@tcp lock: 00000000870d6c11/0xc6b31a1b598e991c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9923 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790740229.897800:0:5824:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f0d85311800 10000000:01000000:1.0:1790740229.897804:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1790740229.897808:0:5824:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8f0d85311800 10000000:01000000:1.0:1790740229.897810:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1790740229.897812:0:5824:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8f0d85311800 from 1 10000000:01000000:1.0:1790740229.897820:0:5824:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1790740229.897838:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: 00000000b9c719bf/0xc6b31a1b598e992a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740229.897844:0:5824:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.158@tcp lock: 00000000b9c719bf/0xc6b31a1b598e992a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740229.897850:0:5824:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.158@tcp lock: 00000000b9c719bf/0xc6b31a1b598e992a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740229.897863:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000073b1be23 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5824:1877727158207104:0@lo:101: 00000100:00100000:1.0:1790740229.897888:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740229.897918:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d668d750 going to sleep for 11 seconds 00000100:00100000:0.0:1790740229.897980:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158207104 00000100:00100000:0.0:1790740229.897984:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158207104 00000100:00100000:0.0:1790740229.898071:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790740229.898078:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000002c9bc83b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+6:5824:x1877727158207104:12345-0@lo:101: 00010000:00010000:0.0:1790740229.898086:0:5836:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740229.898102:0:5836:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fcb7184b/0xc6b31a1b598e9931 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b31a1b598e992a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740229.898117:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fcb7184b/0xc6b31a1b598e9931 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b31a1b598e992a expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740229.898124:0:5836:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fcb7184b/0xc6b31a1b598e9931 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e992a expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740229.898129:0:5836:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fcb7184b, rc 0) 00000100:00100000:0.0:1790740229.898164:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000002c9bc83b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+7:5824:x1877727158207104:12345-0@lo:101: Request processed in 88us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740229.898170:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790740229.898227:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000073b1be23 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5824:1877727158207104:0@lo:101: 00010000:00010000:1.0:1790740229.898236:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.158@tcp lock: 00000000b9c719bf/0xc6b31a1b598e992a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9931 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740229.898243:0:5824:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.158@tcp lock: 00000000b9c719bf/0xc6b31a1b598e992a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598e9931 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790740229.898252:0:5824:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.158@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1790740229.898362:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: 00000000b9c719bf/0xc6b31a1b598e992a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9931 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740229.898369:0:5824:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.158@tcp lock: 00000000b9c719bf/0xc6b31a1b598e992a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9931 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790740229.898376:0:5824:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1790740229.898379:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790740229.898383:0:5824:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8f0d85311800 10000000:01000000:1.0:1790740229.898392:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1790740229.898395:0:5824:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1790740229.898398:0:5824:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1790740229.898411:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: 000000006fd3a7db/0xc6b31a1b598e9938 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740229.898417:0:5824:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.158@tcp lock: 000000006fd3a7db/0xc6b31a1b598e9938 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740229.898424:0:5824:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.158@tcp lock: 000000006fd3a7db/0xc6b31a1b598e9938 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740229.898435:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000073b1be23 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5824:1877727158207232:0@lo:101: 00000100:00100000:1.0:1790740229.898460:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740229.898480:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d668d750 going to sleep for 11 seconds 00000100:00100000:0.0:1790740229.898525:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158207232 00000100:00100000:0.0:1790740229.898529:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158207232 00000100:00100000:0.0:1790740229.898558:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790740229.898564:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000004c952b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+7:5824:x1877727158207232:12345-0@lo:101: 00010000:00010000:0.0:1790740229.898570:0:5836:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740229.898598:0:5836:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000034db2d06/0xc6b31a1b598e993f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b31a1b598e9938 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740229.898609:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000034db2d06/0xc6b31a1b598e993f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b31a1b598e9938 expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740229.898616:0:5836:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000034db2d06/0xc6b31a1b598e993f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e9938 expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740229.898622:0:5836:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000034db2d06, rc 0) 00000100:00100000:0.0:1790740229.898646:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000004c952b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+8:5824:x1877727158207232:12345-0@lo:101: Request processed in 83us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740229.898661:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790740229.898735:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000073b1be23 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5824:1877727158207232:0@lo:101: 00010000:00010000:1.0:1790740229.898745:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.158@tcp lock: 000000006fd3a7db/0xc6b31a1b598e9938 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e993f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740229.898751:0:5824:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.158@tcp lock: 000000006fd3a7db/0xc6b31a1b598e9938 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598e993f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740229.898786:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000073b1be23 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5824:1877727158207360:0@lo:501: 00000100:00100000:1.0:1790740229.898808:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740229.898835:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d668d750 going to sleep for 11 seconds 00000100:00100000:3.0:1790740229.898887:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158207360 00000100:00100000:3.0:1790740229.898892:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158207360 00000100:00100000:3.0:1790740229.898921:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790740229.898926:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000c7e8be88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+8:5824:x1877727158207360:12345-0@lo:501: 00000100:00100000:3.0:1790740229.899113:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000c7e8be88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+9:5824:x1877727158207360:12345-0@lo:501: Request processed in 186us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740229.899120:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790740229.899197:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000073b1be23 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5824:1877727158207360:0@lo:501: 00000100:00100000:1.0:1790740229.899234:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000073b1be23 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5824:1877727158207488:0@lo:503: 00000100:00100000:1.0:1790740229.899269:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740229.899297:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d668d750 going to sleep for 11 seconds 00000100:00100000:0.0:1790740229.899353:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158207488 00000100:00100000:0.0:1790740229.899357:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158207488 00000100:00100000:0.0:1790740229.899385:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790740229.899391:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000a193b0f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+9:5824:x1877727158207488:12345-0@lo:503: 00000100:00100000:0.0:1790740229.899546:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000a193b0f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+9:5824:x1877727158207488:12345-0@lo:503: Request processed in 156us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740229.899553:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790740229.899598:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000073b1be23 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5824:1877727158207488:0@lo:503: 00000100:00100000:3.0:1790740229.900401:0:5866:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001936a48c pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5866:1877727158207616:0@lo:502: 00000100:00100000:3.0:1790740229.900439:0:5866:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740229.900503:0:5866:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d7fb2acc going to sleep for 11 seconds 00000100:00100000:0.0:1790740229.900552:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158207616 00000100:00100000:0.0:1790740229.900557:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158207616 00000100:00100000:0.0:1790740229.900641:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790740229.900656:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000002bde8c19 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+9:5866:x1877727158207616:12345-0@lo:502: 00000100:00100000:0.0:1790740229.900814:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000002bde8c19 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+9:5866:x1877727158207616:12345-0@lo:502: Request processed in 167us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740229.900820:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790740229.900887:0:5866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001936a48c pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5866:1877727158207616:0@lo:502: 00000020:01000000:1.0:1790740229.900907:0:5866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790740229.900917:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740229.900919:0:5866:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1790740229.900923:0:5866:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1790740229.900926:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790740229.900939:0:5866:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000c1579948) 00000020:00000080:1.0:1790740229.900954:0:5866:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1790740229.900959:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1790740229.901029:0:5866:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:1.0:1790740229.901036:0:5866:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc6b31a1b598e994d 00000020:00000080:1.0:1790740229.901262:0:5866:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1790740229.901267:0:5866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790740229.901270:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740229.901271:0:5866:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1790740229.901274:0:5866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790740229.901278:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740229.901279:0:5866:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1790740229.901282:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790740229.901288:0:5866:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000c24d044a) 00000020:00000080:1.0:1790740229.901297:0:5866:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1790740229.901301:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1790740229.901302:0:5866:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1790740229.901305:0:5866:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1790740229.901311:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1790740229.901344:0:5866:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000926e8a37 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1790740229.901362:0:5866:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000588306fb) 00000020:00000080:1.0:1790740229.901372:0:5866:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1790740229.901429:0:5866:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1790740229.901435:0:5866:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc6b31a1b598e9962 00000020:00000080:1.0:1790740229.901546:0:5866:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1790740229.901553:0:5866:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1790740229.901563:0:5866:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xc6b31a1b598e9969 00080000:01000000:1.0:1790740229.901568:0:5866:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:1.0:1790740229.901594:0:5866:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc6b31a1b598e9970 00080000:10000000:1.0:1790740229.901961:0:5866:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:1.0:1790740229.902181:0:5866:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1790740229.906256:0:5866:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1790740229.967483:0:5866:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1790740229.967946:0:5866:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1790740229.970236:0:5866:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1790740229.970470:0:5866:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1790740229.994194:0:5866:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000041dd74dc) 00000020:00000080:2.0:1790740229.994222:0:5866:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1790740229.994321:0:5866:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1790740229.994328:0:5866:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc6b31a1b598e997e 00000020:00000080:2.0:1790740229.998261:0:5866:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1790740229.999843:0:5866:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1790740230.026666:0:5866:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1790740230.053500:0:5866:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1790740230.078448:0:5866:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1790740230.100441:0:5866:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:3.0:1790740230.125846:0:5866:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:3.0:1790740230.190421:0:5866:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xc6b31a1b598e9985 00000020:00000080:2.0:1790740230.190898:0:5866:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1790740230.190910:0:5866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790740230.190916:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790740230.190918:0:5866:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1790740230.190922:0:5866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790740230.190925:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790740230.190927:0:5866:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790740230.190930:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790740230.190932:0:5866:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1790740230.190934:0:5866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790740230.190936:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790740230.190943:0:5866:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:2.0:1790740230.190946:0:5866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790740230.190951:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790740230.190952:0:5866:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1790740230.190956:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1790740230.190993:0:5866:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1790740230.191071:0:5866:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007bfbb34c pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5866:1877727158207744:0@lo:502: 00000100:00100000:2.0:1790740230.191145:0:5866:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740230.191203:0:5866:0:(client.c:2716:ptlrpc_set_wait()) set 0000000078881676 going to sleep for 11 seconds 00000100:00100000:1.0:1790740230.191360:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158207744 00000100:00100000:1.0:1790740230.191367:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158207744 00000100:00100000:1.0:1790740230.191411:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790740230.191419:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000d2e77b11 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+9:5866:x1877727158207744:12345-0@lo:502: 00000100:00100000:1.0:1790740230.191648:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000d2e77b11 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+9:5866:x1877727158207744:12345-0@lo:502: Request processed in 229us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740230.191656:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790740230.191748:0:5866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007bfbb34c pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5866:1877727158207744:0@lo:502: 00000020:01000000:0.0:1790740230.191775:0:5866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790740230.191780:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740230.191782:0:5866:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1790740230.191785:0:5866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1790740230.191956:0:5824:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1790740230.191972:0:5824:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.158@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1790740230.191992:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: 000000006fd3a7db/0xc6b31a1b598e9938 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e993f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740230.192002:0:5824:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.158@tcp lock: 000000006fd3a7db/0xc6b31a1b598e9938 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e993f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790740230.192009:0:5824:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f0d85311800 from 1 10000000:01000000:1.0:1790740230.192011:0:5824:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790740230.192046:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: 0000000028a3969d/0xc6b31a1b598e998c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740230.192054:0:5824:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.158@tcp lock: 0000000028a3969d/0xc6b31a1b598e998c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740230.192061:0:5824:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.158@tcp lock: 0000000028a3969d/0xc6b31a1b598e998c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740230.192082:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c56d4296 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5824:1877727158207872:0@lo:101: 00000100:00100000:1.0:1790740230.192108:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740230.192133:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set 00000000074cf658 going to sleep for 11 seconds 00000100:00100000:0.0:1790740230.192224:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158207872 00000100:00100000:0.0:1790740230.192229:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158207872 00000100:00100000:0.0:1790740230.192260:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790740230.192266:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000081e95d0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+9:5824:x1877727158207872:12345-0@lo:101: 00010000:00010000:0.0:1790740230.192275:0:5836:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740230.192293:0:5836:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000008c5e972/0xc6b31a1b598e9993 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b31a1b598e998c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740230.192318:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000008c5e972/0xc6b31a1b598e9993 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b31a1b598e998c expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740230.192328:0:5836:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000008c5e972/0xc6b31a1b598e9993 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e998c expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740230.192336:0:5836:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000008c5e972, rc 0) 00000100:00100000:0.0:1790740230.192365:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000081e95d0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+10:5824:x1877727158207872:12345-0@lo:101: Request processed in 100us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740230.192370:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790740230.192710:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c56d4296 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5824:1877727158207872:0@lo:101: 00010000:00010000:1.0:1790740230.192722:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.158@tcp lock: 0000000028a3969d/0xc6b31a1b598e998c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9993 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740230.192729:0:5824:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.158@tcp lock: 0000000028a3969d/0xc6b31a1b598e998c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598e9993 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740230.193366:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c56d4296 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5824:1877727158208000:0@lo:256: 00000100:00100000:1.0:1790740230.193414:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740230.193484:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set 00000000074cf658 going to sleep for 11 seconds 00000100:00100000:0.0:1790740230.194824:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158208000 00000100:00100000:0.0:1790740230.194838:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158208000 00000100:00100000:0.0:1790740230.194882:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790740230.194889:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000dc983c0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+10:5824:x1877727158208000:12345-0@lo:256: 20000000:01000000:0.0:1790740230.194912:0:5836:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1790740230.194918:0:5836:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1790740230.195009:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000dc983c0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+10:5824:x1877727158208000:12345-0@lo:256: Request processed in 120us (1594us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740230.195016:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790740230.195248:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c56d4296 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5824:1877727158208000:0@lo:256: 10000000:01000000:3.0:1790740230.196444:0:5824:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790740230.196465:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: 0000000028a3969d/0xc6b31a1b598e998c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9993 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740230.196475:0:5824:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.158@tcp lock: 0000000028a3969d/0xc6b31a1b598e998c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9993 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740230.196482:0:5824:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f0d85311800 from 1 10000000:01000000:3.0:1790740230.196484:0:5824:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790740230.196527:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: 0000000093882e68/0xc6b31a1b598e999a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740230.196534:0:5824:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.158@tcp lock: 0000000093882e68/0xc6b31a1b598e999a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740230.196541:0:5824:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.158@tcp lock: 0000000093882e68/0xc6b31a1b598e999a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740230.196558:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005ccdf621 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5824:1877727158208128:0@lo:101: 00000100:00100000:3.0:1790740230.196621:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740230.196648:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set 0000000035c871b0 going to sleep for 11 seconds 00000100:00100000:0.0:1790740230.196965:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158208128 00000100:00100000:0.0:1790740230.196973:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158208128 00000100:00100000:0.0:1790740230.197006:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790740230.197012:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000e89ca416 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+10:5824:x1877727158208128:12345-0@lo:101: 00010000:00010000:0.0:1790740230.197023:0:5836:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740230.197048:0:5836:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000012af23e2/0xc6b31a1b598e99a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b31a1b598e999a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740230.197080:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000012af23e2/0xc6b31a1b598e99a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b31a1b598e999a expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740230.197089:0:5836:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000012af23e2/0xc6b31a1b598e99a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e999a expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740230.197095:0:5836:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000012af23e2, rc 0) 00000100:00100000:0.0:1790740230.197126:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000e89ca416 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+11:5824:x1877727158208128:12345-0@lo:101: Request processed in 114us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740230.197132:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790740230.197348:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005ccdf621 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5824:1877727158208128:0@lo:101: 00010000:00010000:3.0:1790740230.197359:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.158@tcp lock: 0000000093882e68/0xc6b31a1b598e999a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e99a1 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740230.197366:0:5824:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.158@tcp lock: 0000000093882e68/0xc6b31a1b598e999a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598e99a1 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740230.197413:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005ccdf621 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5824:1877727158208256:0@lo:501: 00000100:00100000:3.0:1790740230.197454:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740230.197478:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set 0000000035c871b0 going to sleep for 11 seconds 00000100:00100000:0.0:1790740230.197529:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158208256 00000100:00100000:0.0:1790740230.197533:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158208256 00000100:00100000:0.0:1790740230.197548:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790740230.197553:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000008c81d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+11:5824:x1877727158208256:12345-0@lo:501: 00000100:00100000:0.0:1790740230.197931:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000008c81d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+11:5824:x1877727158208256:12345-0@lo:501: Request processed in 377us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740230.197937:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790740230.198025:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005ccdf621 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5824:1877727158208256:0@lo:501: 00000100:00100000:3.0:1790740230.198643:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005ccdf621 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5824:1877727158208384:0@lo:503: 00000100:00100000:3.0:1790740230.198686:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740230.198713:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set 0000000035c871b0 going to sleep for 11 seconds 00000100:00100000:0.0:1790740230.198799:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158208384 00000100:00100000:0.0:1790740230.198805:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158208384 00000100:00100000:0.0:1790740230.198829:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790740230.198835:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000635374c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+11:5824:x1877727158208384:12345-0@lo:503: 00000040:00080000:0.0:1790740230.198873:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790740230.198909:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000635374c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+11:5824:x1877727158208384:12345-0@lo:503: Request processed in 75us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740230.198915:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790740230.198994:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005ccdf621 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5824:1877727158208384:0@lo:503: 00000040:00080000:1.0:1790740230.200374:0:5871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1790740230.200869:0:5824:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1790740230.200890:0:5824:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790740230.200949:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: 0000000093882e68/0xc6b31a1b598e999a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e99a1 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740230.200963:0:5824:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.158@tcp lock: 0000000093882e68/0xc6b31a1b598e999a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e99a1 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740230.201008:0:5824:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1790740230.201011:0:5824:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f0d85311800 10000000:01000000:3.0:1790740230.201014:0:5824:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f0d85311800 10000000:01000000:3.0:1790740230.201017:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790740230.201023:0:5824:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f0d85311800 from 1 10000000:01000000:3.0:1790740230.201025:0:5824:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790740230.201077:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: 0000000017175284/0xc6b31a1b598e99a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740230.201085:0:5824:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.158@tcp lock: 0000000017175284/0xc6b31a1b598e99a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740230.201095:0:5824:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.158@tcp lock: 0000000017175284/0xc6b31a1b598e99a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740230.201129:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005ccdf621 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5824:1877727158208512:0@lo:101: 00000100:00100000:3.0:1790740230.201184:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740230.201252:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fd09a9d9 going to sleep for 11 seconds 00000100:00100000:1.0:1790740230.201430:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158208512 00000100:00100000:1.0:1790740230.201437:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158208512 00000100:00100000:1.0:1790740230.201479:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790740230.201485:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000000f35c75e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+11:5824:x1877727158208512:12345-0@lo:101: 00010000:00010000:1.0:1790740230.201497:0:5836:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740230.201522:0:5836:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008322affd/0xc6b31a1b598e99af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b31a1b598e99a8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740230.201544:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008322affd/0xc6b31a1b598e99af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b31a1b598e99a8 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740230.201553:0:5836:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008322affd/0xc6b31a1b598e99af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e99a8 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740230.201721:0:5836:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008322affd, rc 0) 00000100:00100000:1.0:1790740230.201762:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000000f35c75e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+12:5824:x1877727158208512:12345-0@lo:101: Request processed in 278us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740230.201769:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790740230.201813:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005ccdf621 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5824:1877727158208512:0@lo:101: 00010000:00010000:1.0:1790740230.201826:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.158@tcp lock: 0000000017175284/0xc6b31a1b598e99a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e99af expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740230.201843:0:5824:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.158@tcp lock: 0000000017175284/0xc6b31a1b598e99a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598e99af expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740230.201895:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c0d1c61b pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5824:1877727158208640:0@lo:501: 00000100:00100000:1.0:1790740230.201919:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740230.201939:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set 00000000597463a3 going to sleep for 11 seconds 00000100:00100000:3.0:1790740230.202261:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158208640 00000100:00100000:3.0:1790740230.202266:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158208640 00000100:00100000:3.0:1790740230.202300:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790740230.202308:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000979a3e0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+12:5824:x1877727158208640:12345-0@lo:501: 00000100:00100000:3.0:1790740230.202591:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000979a3e0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+12:5824:x1877727158208640:12345-0@lo:501: Request processed in 285us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740230.202598:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790740230.202728:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c0d1c61b pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5824:1877727158208640:0@lo:501: 00000100:00100000:0.0:1790740230.202772:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000de2f0fac pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5824:1877727158208768:0@lo:503: 00000100:00100000:0.0:1790740230.202811:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740230.202828:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set 0000000094d33968 going to sleep for 11 seconds 00000100:00100000:3.0:1790740230.202875:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158208768 00000100:00100000:3.0:1790740230.202879:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158208768 00000100:00100000:3.0:1790740230.202906:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790740230.202911:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000450c0903 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+12:5824:x1877727158208768:12345-0@lo:503: 00000100:00100000:3.0:1790740230.203219:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000450c0903 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+12:5824:x1877727158208768:12345-0@lo:503: Request processed in 308us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740230.203226:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790740230.203315:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000de2f0fac pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5824:1877727158208768:0@lo:503: 00000100:00100000:0.0:1790740230.203694:0:5872:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000de2f0fac pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5872:1877727158208896:0@lo:502: 00000100:00100000:0.0:1790740230.203728:0:5872:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740230.203745:0:5872:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e54d7a9f going to sleep for 11 seconds 00000100:00100000:3.0:1790740230.203791:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158208896 00000100:00100000:3.0:1790740230.203796:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158208896 00000100:00100000:3.0:1790740230.203827:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790740230.203833:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000029bbc2ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+12:5872:x1877727158208896:12345-0@lo:502: 00000100:00100000:3.0:1790740230.203988:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000029bbc2ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+12:5872:x1877727158208896:12345-0@lo:502: Request processed in 155us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740230.203994:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790740230.204472:0:5872:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000de2f0fac pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5872:1877727158208896:0@lo:502: 00000020:01000004:0.0:1790740230.204534:0:5872:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1790740230.204559:0:5872:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000096d350be) 00000020:00000080:0.0:1790740230.205471:0:5872:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1790740230.205659:0:5872:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000926e8a37 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1790740230.205664:0:5872:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000926e8a37 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1790740230.205666:0:5872:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000926e8a37 4 00010000:00080000:0.0:1790740230.205704:0:5872:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000e3d533ce@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.158@tcp at head 00010000:00010000:0.0:1790740230.210750:0:5872:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1790740230.210990:0:5872:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1790740230.211023:0:5872:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1790740230.211049:0:5872:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xc6b31a1b598e99bd 00000100:00080000:0.0:1790740230.211060:0:5872:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790740230.211070:0:5872:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000e3d533ce using connection 192.168.203.158@tcp/0@lo 00000100:00100000:0.0:1790740230.211107:0:5872:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000de2f0fac x1877727158209024/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790740230.211139:0:5872:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1790740230.212647:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000de2f0fac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877727158209024:0@lo:38: 00000100:00100000:3.0:1790740230.212733:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740230.212913:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158209024 00000100:00100000:0.0:1790740230.212921:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158209024 00000100:00100000:0.0:1790740230.212994:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790740230.213000:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000e72816cd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1877727158209024:12345-0@lo:38: 00000100:00100000:0.0:1790740230.213063:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000e72816cd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1877727158209024:12345-0@lo:38: Request processed in 63us (330us total) trans 0 rc -11/-11 00000100:00100000:0.0:1790740230.213070:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790740230.214714:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790740230.214725:0:3302:0:(import.c:65:import_set_state_nolock()) 00000000e3d533ce lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790740230.214732:0:3302:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1790740230.214735:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000de2f0fac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877727158209024:0@lo:38: 00000100:00100000:1.0:1790740230.225772:0:5872:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a8fd74c2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5872:1877727158209152:0@lo:502: 00000100:00100000:1.0:1790740230.225866:0:5872:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740230.225918:0:5872:0:(client.c:2716:ptlrpc_set_wait()) set 000000007b17e2e1 going to sleep for 11 seconds 00000100:00100000:3.0:1790740230.225995:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158209152 00000100:00100000:3.0:1790740230.226003:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158209152 00000100:00100000:3.0:1790740230.226067:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790740230.226076:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000006d4a345e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+12:5872:x1877727158209152:12345-0@lo:502: 00000100:00100000:3.0:1790740230.226331:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000006d4a345e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+12:5872:x1877727158209152:12345-0@lo:502: Request processed in 256us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740230.226339:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790740230.226405:0:5872:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a8fd74c2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5872:1877727158209152:0@lo:502: 00000040:00080000:3.0:1790740230.226431:0:5872:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1790740230.226723:0:5824:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1790740230.226741:0:5824:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790740230.226752:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: 0000000017175284/0xc6b31a1b598e99a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e99af expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740230.226763:0:5824:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.158@tcp lock: 0000000017175284/0xc6b31a1b598e99a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e99af expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1790740230.226806:0:5824:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1790740230.226811:0:5824:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790740230.226812:0:5824:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790740230.226813:0:5824:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790740230.226814:0:5824:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790740230.226815:0:5824:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790740230.226816:0:5824:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790740230.226818:0:5824:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790740230.226819:0:5824:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790740230.226820:0:5824:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790740230.226821:0:5824:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790740230.226822:0:5824:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790740230.226824:0:5824:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1790740230.226826:0:5824:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790740230.226828:0:5824:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790740230.226828:0:5824:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790740230.226829:0:5824:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790740230.226830:0:5824:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790740230.226831:0:5824:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790740230.226832:0:5824:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790740230.226833:0:5824:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790740230.226834:0:5824:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790740230.226834:0:5824:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790740230.226835:0:5824:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790740230.226836:0:5824:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790740230.226849:0:5824:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1790740230.226859:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005089b993 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5824:1877727158209280:0@lo:253: 00000100:00100000:1.0:1790740230.226891:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740230.226910:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set 00000000074cf658 going to sleep for 11 seconds 00000100:00100000:3.0:1790740230.227328:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158209280 00000100:00100000:3.0:1790740230.227335:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158209280 00000100:00100000:3.0:1790740230.227365:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790740230.227370:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000cd3587dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+12:5824:x1877727158209280:12345-0@lo:253: 20000000:01000000:3.0:1790740230.227390:0:5835:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1790740230.227402:0:5835:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1790740230.274723:0:5835:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1790740230.274742:0:5835:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1790740230.274776:0:5858:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1790740230.274781:0:5858:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1790740230.274803:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000b64abb41/0xc6b31a1b598e99c4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740230.274823:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000008c5e972/0xc6b31a1b598e9993 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e998c expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740230.274831:0:5858:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000b64abb41/0xc6b31a1b598e99c4 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740230.274869:0:5858:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000008c5e972/0xc6b31a1b598e9993 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b31a1b598e998c expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740230.274883:0:5858:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000008c5e972/0xc6b31a1b598e9993 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b31a1b598e998c expref: 12 pid: 5836 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740230.274897:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000053bf29e7 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1877727158209408:0@lo:104: 00000100:00100000:0.0:1790740230.274963:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740230.275144:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set 0000000022af08d0 going to sleep for 11 seconds 00000100:00100000:2.0:1790740230.277714:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158209408 00000100:00100000:2.0:1790740230.277730:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158209408 00000100:00100000:2.0:1790740230.277786:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790740230.277796:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000108b2b7d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+3:5858:x1877727158209408:12345-0@lo:104: 00010000:00010000:2.0:1790740230.277815:0:5826:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.158@tcp lock: 0000000028a3969d/0xc6b31a1b598e998c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598e9993 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740230.277911:0:5826:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790740230.277917:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000108b2b7d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+3:5858:x1877727158209408:12345-0@lo:104: Request processed in 123us (2954us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740230.277925:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1790740230.277949:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790740230.277954:0:5831:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.158@tcp lock: 0000000028a3969d/0xc6b31a1b598e998c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598e9993 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740230.277962:0:5831:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock 0000000028a3969d already unused, calling callback (00000000e9451455) 10000000:00010000:2.0:1790740230.277966:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.158@tcp lock: 0000000028a3969d/0xc6b31a1b598e998c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b31a1b598e9993 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740230.277991:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.158@tcp lock: 0000000028a3969d/0xc6b31a1b598e998c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b31a1b598e9993 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790740230.277998:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.158@tcp lock: 0000000028a3969d/0xc6b31a1b598e998c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b31a1b598e9993 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790740230.278003:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:0.0:1790740230.278138:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000053bf29e7 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1877727158209408:0@lo:104: 00010000:00010000:0.0:1790740230.278162:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000b64abb41/0xc6b31a1b598e99c4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740230.278233:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.158@tcp lock: 0000000028a3969d/0xc6b31a1b598e998c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9993 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740230.278240:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790740230.278269:0:5831:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.158@tcp lock: 0000000028a3969d/0xc6b31a1b598e998c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9993 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740230.278276:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.158@tcp lock: 0000000028a3969d/0xc6b31a1b598e998c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9993 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740230.278294:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740230.278296:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740230.278297:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740230.278391:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790740230.278403:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000009cd4eeb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3303:1877727158209536:0@lo:103: 00000100:00100000:3.0:1790740230.278443:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740230.278717:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158209536 00000100:00100000:2.0:1790740230.278724:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158209536 00010000:00010000:2.0:1790740230.278743:0:5828:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000008c5e972/0xc6b31a1b598e9993 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598e998c expref: 13 pid: 5836 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740230.278772:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790740230.278778:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000330ee11c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+13:3303:x1877727158209536:12345-0@lo:103: 00010000:00010000:2.0:1790740230.278787:0:5828:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740230.278792:0:5828:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000008c5e972/0xc6b31a1b598e9993 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598e998c expref: 13 pid: 5836 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740230.278806:0:5828:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000008c5e972/0xc6b31a1b598e9993 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b31a1b598e998c expref: 13 pid: 5836 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740230.278820:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000008c5e972/0xc6b31a1b598e9993 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b31a1b598e998c expref: 13 pid: 5836 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740230.278834:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000b64abb41/0xc6b31a1b598e99c4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740230.278841:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b64abb41/0xc6b31a1b598e99c4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790740230.278854:0:5828:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004072871s 00010000:00010000:2.0:1790740230.278857:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b64abb41/0xc6b31a1b598e99c4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740230.278863:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b64abb41/0xc6b31a1b598e99c4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740230.278869:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000b64abb41/0xc6b31a1b598e99c4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740230.278874:0:5828:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000b64abb41/0xc6b31a1b598e99c4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740230.278880:0:5828:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock 00000000b64abb41 already unused, calling callback (000000002702e643) 00010000:00010000:2.0:1790740230.278883:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000b64abb41/0xc6b31a1b598e99c4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740230.278889:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000b64abb41/0xc6b31a1b598e99c4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740230.278909:0:5828:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000b64abb41/0xc6b31a1b598e99c4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740230.278919:0:5828:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790740230.278945:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000330ee11c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+12:3303:x1877727158209536:12345-0@lo:103: Request processed in 169us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740230.278951:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790740230.278976:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000009cd4eeb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3303:1877727158209536:0@lo:103: 00010000:00010000:2.0:1790740230.278988:0:5858:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000b64abb41/0xc6b31a1b598e99c4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740230.278994:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000b64abb41/0xc6b31a1b598e99c4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740230.278998:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b64abb41/0xc6b31a1b598e99c4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740230.283186:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000cd3587dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+11:5824:x1877727158209280:12345-0@lo:253: Request processed in 55808us (56287us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740230.283203:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790740230.283325:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005089b993 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5824:1877727158209280:0@lo:253: 10000000:01000000:1.0:1790740230.283341:0:5824:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1790740230.283345:0:5824:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790740230.283347:0:5824:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790740230.283348:0:5824:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790740230.283349:0:5824:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790740230.283350:0:5824:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790740230.283351:0:5824:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790740230.283352:0:5824:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790740230.283354:0:5824:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790740230.283361:0:5824:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790740230.283363:0:5824:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790740230.283364:0:5824:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790740230.283366:0:5824:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1790740230.283379:0:5824:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1790740230.289357:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1790740230.289897:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1790740230.290301:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1790740230.290474:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1790740230.292463:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1790740230.292918:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1790740230.293956:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1790740230.294200:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1790740230.294406:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1790740230.296023:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1790740230.296442:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1790740230.297212:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:2.0:1790740230.375105:0:5824:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1790740230.420323:0:5824:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1790740230.421122:0:5877:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1790740230.421127:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1790740230.421671:0:5878:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1790740230.423659:0:5824:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1790740230.423828:0:5824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1790740230.424254:0:5824:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1790740230.424261:0:5824:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1790740230.424390:0:5824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790740230.431309:0:5824:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1790740230.431866:0:5824:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1790740230.431901:0:5824:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1790740230.432201:0:5824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1790740230.432349:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1790740230.437547:0:5824:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1790740230.437775:0:5824:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1790740230.437917:0:5824:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1790740230.439425:0:5824:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1790740230.440400:0:5824:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1790740230.440719:0:5824:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1790740230.440891:0:5824:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1790740230.441055:0:5824:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1790740230.441861:0:5824:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1790740230.442049:0:5824:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1790740230.442197:0:5824:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1790740230.442377:0:5824:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1790740230.442555:0:5824:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1790740230.442716:0:5824:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1790740230.442854:0:5824:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1790740230.442992:0:5824:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1790740230.443293:0:5824:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1790740230.443432:0:5824:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1790740230.444174:0:5824:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1790740230.444318:0:5824:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1790740230.444486:0:5824:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1790740230.444685:0:5824:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1790740230.444840:0:5824:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1790740230.445137:0:5824:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1790740230.445279:0:5824:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1790740230.445433:0:5824:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1790740230.445610:0:5824:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1790740230.445776:0:5824:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1790740230.445913:0:5824:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1790740230.446562:0:5824:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1790740230.446730:0:5824:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1790740230.446885:0:5824:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1790740230.447103:0:5824:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:3.0:1790740230.451504:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790740230.478351:0:5878:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:0.0:1790740230.558518:0:5824:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1790740230.558561:0:5824:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa288816b7988 00100000:10000000:0.0:1790740230.558569:0:5824:0:(lfsck_lib.c:3084:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1790740230.569757:0:5824:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1790740230.569774:0:5824:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.158@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1790740230.569795:0:5824:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1790740230.569810:0:5824:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:0.0:1790740230.621146:0:5878:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1790740230.621225:0:5878:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1790740230.621230:0:5878:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1790740231.474692:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740232.497083:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740233.525831:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740234.546015:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790740234.745545:0:6120:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:2.0:1790740235.568839:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1790740235.568849:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1790740235.568852:0:38:0:(import.c:65:import_set_state_nolock()) 00000000e3d533ce lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790740235.568875:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000e3d533ce using connection 192.168.203.158@tcp/0@lo 00000100:00100000:2.0:1790740235.568907:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000c8748083 x1877727158209792/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790740235.569123:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790740235.569137:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000009cd4eeb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3306:1877727158209664:0@lo:400: 00000100:00100000:1.0:1790740235.569200:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740235.569367:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158209664 00000100:00100000:2.0:1790740235.569375:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158209664 00000100:00100000:2.0:1790740235.569458:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790740235.569467:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000d00128b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+11:3306:x1877727158209664:12345-0@lo:400: 00000100:00100000:2.0:1790740235.569536:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000d00128b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+11:3306:x1877727158209664:12345-0@lo:400: Request processed in 71us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740235.569544:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790740235.569655:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000009cd4eeb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3306:1877727158209664:0@lo:400: 00000100:00100000:3.0:1790740235.569862:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c8748083 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877727158209792:0@lo:38: 00010000:00010000:2.0:1790740235.569986:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740235.570125:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740235.570691:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158209792 00000100:00100000:2.0:1790740235.570698:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158209792 00000100:00100000:2.0:1790740235.570763:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790740235.570768:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000073ab3c46 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3302:x1877727158209792:12345-0@lo:38: 00010000:00080000:2.0:1790740235.570792:0:5844:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 151 last 0 00000020:00000080:2.0:1790740235.570826:0:5844:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xc6b31a1b598e99cb 00000004:00100000:2.0:1790740235.570902:0:5844:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1790740235.572342:0:5844:0:(import.c:65:import_set_state_nolock()) 00000000f51aa08e : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790740235.572437:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000073ab3c46 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877727158209792:12345-0@lo:38: Request processed in 1667us (2310us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740235.572447:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1790740235.572534:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000c8748083 x1877727158209792/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790740245 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1790740235.572551:0:3302:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1790740235.572557:0:3302:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1790740235.572562:0:3302:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1790740235.572564:0:3302:0:(import.c:65:import_set_state_nolock()) 00000000e3d533ce lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790740235.572569:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c8748083 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877727158209792:0@lo:38: 00010000:00010000:2.0:1790740236.593478:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740237.616724:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740238.644234:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1790740238.647623:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1790740238.647630:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f0d85311800 from 3 10000000:01000000:3.0:1790740238.647634:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790740238.647679:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: 00000000ca5e4c56/0xc6b31a1b598e99d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740238.647692:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.158@tcp lock: 00000000ca5e4c56/0xc6b31a1b598e99d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740238.647702:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.158@tcp lock: 00000000ca5e4c56/0xc6b31a1b598e99d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740238.647723:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006cbd868d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158209920:0@lo:101: 00000100:00100000:3.0:1790740238.647792:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740238.649286:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158209920 00000100:00100000:0.0:1790740238.649298:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158209920 00000100:00100000:0.0:1790740238.649354:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790740238.649364:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000019fdedcb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+11:5841:x1877727158209920:12345-0@lo:101: 00010000:00010000:0.0:1790740238.649380:0:5835:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740238.649396:0:5835:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cc71bf3e/0xc6b31a1b598e99d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b31a1b598e99d2 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740238.649420:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cc71bf3e/0xc6b31a1b598e99d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b31a1b598e99d2 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740238.649430:0:5835:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cc71bf3e/0xc6b31a1b598e99d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e99d2 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740238.649438:0:5835:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cc71bf3e, rc 0) 00000100:00100000:0.0:1790740238.649503:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000019fdedcb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+12:5841:x1877727158209920:12345-0@lo:101: Request processed in 141us (1711us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740238.649510:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790740238.650816:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bcbb4f32 going to sleep for 11 seconds 00000100:00100000:3.0:1790740238.651063:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006cbd868d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158209920:0@lo:101: 00010000:00010000:3.0:1790740238.651085:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.158@tcp lock: 00000000ca5e4c56/0xc6b31a1b598e99d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e99d9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740238.651096:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.158@tcp lock: 00000000ca5e4c56/0xc6b31a1b598e99d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598e99d9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740238.651243:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006cbd868d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158210048:0@lo:256: 00000100:00100000:3.0:1790740238.651362:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740238.651399:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bcbb4f32 going to sleep for 11 seconds 00000100:00100000:1.0:1790740238.651489:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158210048 00000100:00100000:1.0:1790740238.651496:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158210048 00000100:00100000:1.0:1790740238.651538:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790740238.651554:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000054f87b1f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+12:5841:x1877727158210048:12345-0@lo:256: 20000000:01000000:1.0:1790740238.651711:0:5837:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1790740238.651728:0:5837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790740238.651731:0:5837:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1790740238.651817:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000054f87b1f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+12:5841:x1877727158210048:12345-0@lo:256: Request processed in 273us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740238.651832:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790740238.652276:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006cbd868d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158210048:0@lo:256: 10000000:01000000:3.0:1790740238.652317:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790740238.652324:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: 00000000ca5e4c56/0xc6b31a1b598e99d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e99d9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740238.652333:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.158@tcp lock: 00000000ca5e4c56/0xc6b31a1b598e99d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e99d9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1790740239.612231:0:6322:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc135c9e30 20000000:00000080:3.0:1790740239.612249:0:6322:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f0db6f08400 uarg=0000000000000000 20000000:01000000:3.0:1790740239.612280:0:6322:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1790740239.612287:0:6322:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1790740239.612291:0:6322:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1790740239.612756:0:6322:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1790740239.612768:0:6322:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1790740239.637906:0:6322:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790740239.638485:0:6322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1790740239.638544:0:6322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1790740239.638622:0:6322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1790740239.638643:0:6322:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1790740239.638661:0:6322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000006f4174d4/0xc6b31a1b598e99e0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740239.638677:0:6322:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000012af23e2/0xc6b31a1b598e99a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e999a expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740239.638685:0:6322:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000006f4174d4/0xc6b31a1b598e99e0 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740239.638718:0:6322:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000012af23e2/0xc6b31a1b598e99a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b31a1b598e999a expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740239.638731:0:6322:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000012af23e2/0xc6b31a1b598e99a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b31a1b598e999a expref: 11 pid: 5836 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740239.638952:0:6322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eb7480c5 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6322:1877727158210176:0@lo:104: 00000100:00100000:2.0:1790740239.639011:0:6322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740239.639063:0:6322:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bab2faf3 going to sleep for 11 seconds 00000100:00100000:3.0:1790740239.639830:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158210176 00000100:00100000:3.0:1790740239.639840:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158210176 00000100:00100000:3.0:1790740239.639881:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790740239.639889:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000095b5ae52 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+3:6322:x1877727158210176:12345-0@lo:104: 00010000:00010000:3.0:1790740239.639903:0:5827:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.158@tcp lock: 0000000093882e68/0xc6b31a1b598e999a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598e99a1 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740239.639994:0:5827:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790740239.640000:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000095b5ae52 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+3:6322:x1877727158210176:12345-0@lo:104: Request processed in 113us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740239.640017:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1790740239.640395:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790740239.640401:0:5831:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.158@tcp lock: 0000000093882e68/0xc6b31a1b598e999a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598e99a1 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740239.640408:0:5831:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock 0000000093882e68 already unused, calling callback (00000000e9451455) 10000000:00010000:0.0:1790740239.640417:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.158@tcp lock: 0000000093882e68/0xc6b31a1b598e999a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b31a1b598e99a1 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740239.640424:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.158@tcp lock: 0000000093882e68/0xc6b31a1b598e999a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b31a1b598e99a1 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790740239.640430:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.158@tcp lock: 0000000093882e68/0xc6b31a1b598e999a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b31a1b598e99a1 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740239.640436:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790740239.640491:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.158@tcp lock: 0000000093882e68/0xc6b31a1b598e999a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e99a1 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740239.640498:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790740239.640516:0:5831:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.158@tcp lock: 0000000093882e68/0xc6b31a1b598e999a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e99a1 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740239.640522:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.158@tcp lock: 0000000093882e68/0xc6b31a1b598e999a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e99a1 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740239.640540:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740239.640542:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740239.640543:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740239.640557:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000053bf29e7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3306:1877727158210304:0@lo:103: 00000100:00100000:0.0:1790740239.640623:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740239.640673:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158210304 00000100:00100000:0.0:1790740239.640678:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158210304 00010000:00010000:0.0:1790740239.640698:0:5828:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000012af23e2/0xc6b31a1b598e99a1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598e999a expref: 12 pid: 5836 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740239.640718:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790740239.640731:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000fff81d4a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+12:3306:x1877727158210304:12345-0@lo:103: 00010000:00010000:0.0:1790740239.640742:0:5828:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740239.640747:0:5828:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000012af23e2/0xc6b31a1b598e99a1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598e999a expref: 12 pid: 5836 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740239.640756:0:5828:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000012af23e2/0xc6b31a1b598e99a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b31a1b598e999a expref: 12 pid: 5836 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740239.640773:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000006f4174d4/0xc6b31a1b598e99e0 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740239.640780:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006f4174d4/0xc6b31a1b598e99e0 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740239.640793:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006f4174d4/0xc6b31a1b598e99e0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740239.640799:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006f4174d4/0xc6b31a1b598e99e0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740239.640805:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000006f4174d4/0xc6b31a1b598e99e0 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740239.640811:0:5828:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000006f4174d4/0xc6b31a1b598e99e0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740239.640817:0:5828:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock 000000006f4174d4 already unused, calling callback (000000002702e643) 00010000:00010000:0.0:1790740239.640820:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000006f4174d4/0xc6b31a1b598e99e0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740239.640827:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000006f4174d4/0xc6b31a1b598e99e0 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740239.640841:0:5828:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000006f4174d4/0xc6b31a1b598e99e0 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740239.640851:0:5828:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740239.640878:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000fff81d4a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+12:3306:x1877727158210304:12345-0@lo:103: Request processed in 149us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740239.640885:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790740239.640934:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000053bf29e7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3306:1877727158210304:0@lo:103: 00010000:00010000:2.0:1790740239.643661:0:6322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000012af23e2/0xc6b31a1b598e99a1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b31a1b598e999a expref: 11 pid: 5836 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740239.643684:0:6322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eb7480c5 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6322:1877727158210176:0@lo:104: 00010000:00010000:2.0:1790740239.643709:0:6322:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000006f4174d4/0xc6b31a1b598e99e0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740239.643718:0:6322:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000006f4174d4/0xc6b31a1b598e99e0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740239.643724:0:6322:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000006f4174d4/0xc6b31a1b598e99e0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740239.643746:0:6322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006f4174d4/0xc6b31a1b598e99e0 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740239.671131:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740240.689182:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740240.689401:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005089b993 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3303:1877727158210432:0@lo:400: 00000100:00100000:2.0:1790740240.689482:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740240.689538:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790740240.689544:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000797a8495 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877727158210560:0@lo:400: 00000100:00100000:2.0:1790740240.689595:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740240.689628:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158210560 00000100:00100000:2.0:1790740240.689635:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158210560 00000100:00100000:2.0:1790740240.689678:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790740240.689686:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000eb7480c5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877727158210560:12345-0@lo:400: 00000100:00100000:2.0:1790740240.689735:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000eb7480c5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877727158210560:12345-0@lo:400: Request processed in 50us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740240.689741:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1790740240.689780:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000797a8495 x1877727158210560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740240.689792:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000797a8495 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877727158210560:0@lo:400: 00000100:00100000:1.0:1790740240.690076:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158210432 00000100:00100000:1.0:1790740240.690082:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158210432 00000100:00100000:1.0:1790740240.690115:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790740240.690121:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000009ac940bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+11:3303:x1877727158210432:12345-0@lo:400: 00000100:00100000:1.0:1790740240.690154:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000009ac940bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+11:3303:x1877727158210432:12345-0@lo:400: Request processed in 35us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740240.690160:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790740240.690235:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005089b993 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3303:1877727158210432:0@lo:400: 00010000:00010000:2.0:1790740241.713922:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740242.737185:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740243.760792:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740244.786607:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740245.809566:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006cbd868d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3305:1877727158210688:0@lo:400: 00000100:00100000:0.0:1790740245.809649:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a94b3c4c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877727158210816:0@lo:400: 00000100:00100000:1.0:1790740245.809658:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740245.809757:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158210688 00000100:00100000:0.0:1790740245.809765:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740245.809766:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158210688 00000100:00100000:3.0:1790740245.809814:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790740245.809824:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000bea49b05 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+11:3305:x1877727158210688:12345-0@lo:400: 00000100:00100000:3.0:1790740245.809885:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000bea49b05 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+11:3305:x1877727158210688:12345-0@lo:400: Request processed in 62us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740245.809892:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790740245.809950:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006cbd868d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3305:1877727158210688:0@lo:400: 00000100:00100000:1.0:1790740245.811301:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158210816 00000100:00100000:1.0:1790740245.811314:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158210816 00000100:00100000:1.0:1790740245.811364:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790740245.811372:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000053bf29e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877727158210816:12345-0@lo:400: 00000100:00100000:1.0:1790740245.811456:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000053bf29e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877727158210816:12345-0@lo:400: Request processed in 85us (1694us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740245.811463:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1790740245.811801:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000a94b3c4c x1877727158210816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740245.811816:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a94b3c4c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877727158210816:0@lo:400: 00010000:00010000:2.0:1790740245.813702:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1790740246.112506:0:6697:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1790740246.112510:0:6697:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1790740246.112716:0:6697:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000ea349c71 00000020:01000004:3.0:1790740246.112732:0:6697:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1790740246.112742:0:6697:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1790740246.112757:0:6697:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (000000003681b1ba) 00000020:00000080:3.0:1790740246.112770:0:6697:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1790740246.136689:0:6697:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1790740246.137023:0:6697:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1790740246.162309:0:6697:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1790740246.168044:0:6697:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1790740246.168082:0:6697:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1790740246.168145:0:6697:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1790740246.168175:0:6697:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1790740246.168710:0:6697:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1790740246.168720:0:6697:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790740246.168730:0:6697:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc6b31a1b598e99ee 00000020:01000004:2.0:1790740246.168737:0:6697:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1790740246.168757:0:6697:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.158@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1790740246.168760:0:6697:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.158@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1790740246.168765:0:6697:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1790740246.168769:0:6697:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1790740246.168780:0:6697:0:(genops.c:413:class_newdev()) Allocate new device OSS (000000002b1dccd1) 00000020:00000080:2.0:1790740246.168791:0:6697:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1790740246.170056:0:6697:0:(service.c:173:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790740246.170222:0:6697:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1790740246.170228:0:6697:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1790740246.173083:0:6697:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1790740246.173095:0:6697:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1790740246.174201:0:6697:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1790740246.174219:0:6697:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1790740246.181195:0:6697:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790740246.181737:0:6697:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1790740246.181744:0:6697:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1790740246.186715:0:6697:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1790740246.186729:0:6697:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1790740246.228413:0:6697:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790740246.228699:0:6697:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1790740246.228706:0:6697:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1790740246.234441:0:6697:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1790740246.234550:0:6697:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1790740246.236728:0:6697:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1790740246.236740:0:6697:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1790740246.240666:0:6697:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790740246.240859:0:6697:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1790740246.240866:0:6697:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1790740246.241757:0:6697:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1790740246.241776:0:6697:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1790740246.345969:0:6697:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790740246.346177:0:6697:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1790740246.346184:0:6697:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1790740246.351972:0:6697:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1790740246.351992:0:6697:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1790740246.352713:0:6697:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1790740246.352737:0:6697:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1790740246.352744:0:6697:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.158@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1790740246.392743:0:6697:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.158@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790740246.392780:0:6697:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.158@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1790740246.392784:0:6697:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790740246.392786:0:6697:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790740246.392787:0:6697:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790740246.392788:0:6697:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790740246.392793:0:6697:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790740246.392795:0:6697:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790740246.392796:0:6697:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790740246.392797:0:6697:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790740246.392798:0:6697:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790740246.392799:0:6697:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790740246.392801:0:6697:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790740246.392804:0:6697:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1790740246.392806:0:6697:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790740246.392807:0:6697:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790740246.392808:0:6697:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790740246.392809:0:6697:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790740246.392810:0:6697:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790740246.392811:0:6697:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790740246.392811:0:6697:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790740246.392812:0:6697:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790740246.392813:0:6697:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790740246.392814:0:6697:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790740246.392814:0:6697:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790740246.392841:0:6697:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1790740246.392858:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000062a5cbb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:6697:1877727158210944:0@lo:253: 00000100:00100000:2.0:1790740246.392992:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740246.393105:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158210944 00000100:00100000:0.0:1790740246.393113:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158210944 00000100:00100000:0.0:1790740246.393162:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790740246.393169:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000088b8a80c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+11:6697:x1877727158210944:12345-0@lo:253: 20000000:01000000:0.0:1790740246.393195:0:5835:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1790740246.393198:0:5835:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1790740246.393203:0:5835:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1790740246.393206:0:5835:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000100:00100000:2.0:1790740246.394071:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set 0000000034de6994 going to sleep for 11 seconds 00000040:00080000:0.0:1790740246.394148:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790740246.394324:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1790740246.394348:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1790740246.394382:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1790740246.394388:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1790740246.394435:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1790740246.394478:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1790740246.394822:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1790740246.394838:0:5835:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.158@tcp 20000000:01000000:0.0:1790740246.394840:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.158@tcp (null) (null) (null) 00000040:00080000:0.0:1790740246.394866:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1790740246.394872:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1790740246.394907:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1790740246.394914:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.158@tcp (null) (null) 00000040:00080000:0.0:1790740246.395237:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1790740246.395247:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1790740246.395271:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1790740246.395312:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1790740246.401532:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1790740246.401563:0:5835:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.158@tcp 20000000:01000000:0.0:1790740246.401566:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.158@tcp (null) (null) (null) 00000040:00080000:0.0:1790740246.401630:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1790740246.401639:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1790740246.401669:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1790740246.401676:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.158@tcp (null) (null) 00000040:00080000:0.0:1790740246.401719:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1790740246.401728:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1790740246.401757:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1790740246.401988:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1790740246.402006:0:5835:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1790740246.402010:0:5835:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1790740246.402015:0:5835:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1790740246.402017:0:5835:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1790740246.402026:0:5835:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1790740246.402038:0:5835:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1790740246.402041:0:5835:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1790740246.402073:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1790740246.402076:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1790740246.403073:0:6712:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1790740246.403143:0:6712:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1790740246.403476:0:6712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1790740246.404271:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1790740246.404381:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1790740246.404432:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:0.0:1790740246.404446:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1790740246.404448:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1790740246.408799:0:6713:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1790740246.408902:0:6713:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1790740246.409006:0:6713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1790740246.409414:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1790740246.409455:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1790740246.409523:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1790740246.409537:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1790740246.409540:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1790740246.410998:0:6714:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1790740246.411602:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1790740246.411664:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1790740246.411733:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 10000000:01000000:0.0:1790740246.411751:0:5835:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1790740246.411769:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000df33269c/0xc6b31a1b598e99fc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740246.411787:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d09c8e22/0xc6b31a1b598e9923 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e991c expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740246.411794:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000034db2d06/0xc6b31a1b598e993f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e9938 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740246.411799:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000008322affd/0xc6b31a1b598e99af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e99a8 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740246.411806:0:5835:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000df33269c/0xc6b31a1b598e99fc lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740246.411845:0:5835:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000008322affd/0xc6b31a1b598e99af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b31a1b598e99a8 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740246.411870:0:5835:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000008322affd/0xc6b31a1b598e99af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b31a1b598e99a8 expref: 11 pid: 5836 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740246.411886:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f79eb9fc pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5835:1877727158211072:0@lo:104: 00000100:00100000:0.0:1790740246.411948:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790740246.412005:0:5835:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000034db2d06/0xc6b31a1b598e993f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b31a1b598e9938 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740246.412012:0:5835:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000034db2d06/0xc6b31a1b598e993f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b31a1b598e9938 expref: 11 pid: 5836 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740246.412020:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000065924de2 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5835:1877727158211200:0@lo:104: 00000100:00100000:0.0:1790740246.412041:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790740246.412071:0:5835:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d09c8e22/0xc6b31a1b598e9923 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b31a1b598e991c expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740246.412078:0:5835:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d09c8e22/0xc6b31a1b598e9923 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b31a1b598e991c expref: 11 pid: 5835 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740246.412085:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f3e79df8 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5835:1877727158211328:0@lo:104: 00000100:00100000:0.0:1790740246.412103:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740246.412112:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set 000000000915af47 going to sleep for 11 seconds 00000100:00100000:3.0:1790740246.412378:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158211072 00000100:00100000:3.0:1790740246.412386:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158211072 00000100:00100000:3.0:1790740246.412431:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158211200 00000100:00100000:3.0:1790740246.412435:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158211200 00000100:00100000:3.0:1790740246.412445:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158211328 00000100:00100000:3.0:1790740246.412448:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158211328 00000100:00100000:3.0:1790740246.412460:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790740246.412467:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000656c83b2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+5:5835:x1877727158211072:12345-0@lo:104: 00010000:00010000:3.0:1790740246.412478:0:5826:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.158@tcp lock: 0000000017175284/0xc6b31a1b598e99a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598e99af expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740246.412543:0:5826:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790740246.412548:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000656c83b2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+5:5835:x1877727158211072:12345-0@lo:104: Request processed in 82us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740246.412554:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790740246.412595:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790740246.412602:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000f6eff25c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+4:5835:x1877727158211200:12345-0@lo:104: 00010000:00010000:3.0:1790740246.412618:0:5826:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.158@tcp lock: 000000006fd3a7db/0xc6b31a1b598e9938 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598e993f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740246.412651:0:5826:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1790740246.412655:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000f6eff25c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+4:5835:x1877727158211200:12345-0@lo:104: Request processed in 56us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740246.412673:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790740246.412688:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790740246.412693:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000006883b63d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+3:5835:x1877727158211328:12345-0@lo:104: 00010000:00010000:3.0:1790740246.412700:0:5826:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.158@tcp lock: 00000000870d6c11/0xc6b31a1b598e991c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598e9923 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740246.412726:0:5826:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1790740246.412730:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000006883b63d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+3:5835:x1877727158211328:12345-0@lo:104: Request processed in 39us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740246.412735:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1790740246.412751:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1790740246.412756:0:5831:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.158@tcp lock: 0000000017175284/0xc6b31a1b598e99a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598e99af expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740246.412764:0:5831:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock 0000000017175284 already unused, calling callback (00000000e9451455) 10000000:00010000:3.0:1790740246.412766:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.158@tcp lock: 0000000017175284/0xc6b31a1b598e99a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b31a1b598e99af expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740246.412774:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.158@tcp lock: 0000000017175284/0xc6b31a1b598e99a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b31a1b598e99af expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790740246.412780:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.158@tcp lock: 0000000017175284/0xc6b31a1b598e99a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b31a1b598e99af expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740246.412785:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790740246.412812:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.158@tcp lock: 0000000017175284/0xc6b31a1b598e99a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e99af expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740246.412819:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790740246.412843:0:5831:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.158@tcp lock: 0000000017175284/0xc6b31a1b598e99a8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e99af expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740246.412850:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.158@tcp lock: 0000000017175284/0xc6b31a1b598e99a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e99af expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740246.412864:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790740246.412866:0:5831:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.158@tcp lock: 000000006fd3a7db/0xc6b31a1b598e9938 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598e993f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740246.412872:0:5831:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock 000000006fd3a7db already unused, calling callback (00000000e9451455) 10000000:00010000:3.0:1790740246.412873:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.158@tcp lock: 000000006fd3a7db/0xc6b31a1b598e9938 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b31a1b598e993f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740246.412879:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.158@tcp lock: 000000006fd3a7db/0xc6b31a1b598e9938 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b31a1b598e993f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790740246.412885:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.158@tcp lock: 000000006fd3a7db/0xc6b31a1b598e9938 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b31a1b598e993f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740246.412890:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790740246.412902:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.158@tcp lock: 000000006fd3a7db/0xc6b31a1b598e9938 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e993f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740246.412907:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790740246.412911:0:5831:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.158@tcp lock: 000000006fd3a7db/0xc6b31a1b598e9938 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e993f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740246.412916:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.158@tcp lock: 000000006fd3a7db/0xc6b31a1b598e9938 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e993f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740246.412928:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740246.412936:0:5831:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.158@tcp lock: 00000000870d6c11/0xc6b31a1b598e991c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598e9923 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740246.412942:0:5831:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock 00000000870d6c11 already unused, calling callback (00000000e9451455) 10000000:00010000:3.0:1790740246.412944:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.158@tcp lock: 00000000870d6c11/0xc6b31a1b598e991c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b31a1b598e9923 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740246.412950:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.158@tcp lock: 00000000870d6c11/0xc6b31a1b598e991c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b31a1b598e9923 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790740246.412955:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.158@tcp lock: 00000000870d6c11/0xc6b31a1b598e991c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b31a1b598e9923 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740246.412959:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790740246.412971:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.158@tcp lock: 00000000870d6c11/0xc6b31a1b598e991c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9923 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740246.412977:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790740246.412989:0:5831:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.158@tcp lock: 00000000870d6c11/0xc6b31a1b598e991c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9923 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740246.412995:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.158@tcp lock: 00000000870d6c11/0xc6b31a1b598e991c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9923 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740246.413008:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740246.413010:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740246.413011:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740246.413017:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740246.413036:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006cbd868d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3303:1877727158211456:0@lo:103: 00000100:00100000:3.0:1790740246.413064:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740246.413088:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790740246.413102:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000077ebe7d0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3303:1877727158211584:0@lo:103: 00000100:00100000:3.0:1790740246.413124:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740246.413150:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d4d02dd1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3305:1877727158211712:0@lo:103: 00000100:00100000:3.0:1790740246.413171:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740246.413200:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158211456 00000100:00100000:3.0:1790740246.413204:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158211456 00010000:00010000:3.0:1790740246.413219:0:5828:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000008322affd/0xc6b31a1b598e99af lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598e99a8 expref: 12 pid: 5836 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740246.413234:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158211584 00000100:00100000:3.0:1790740246.413236:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158211584 00010000:00010000:3.0:1790740246.413244:0:5828:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000034db2d06/0xc6b31a1b598e993f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598e9938 expref: 13 pid: 5836 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740246.413254:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158211712 00000100:00100000:3.0:1790740246.413256:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158211712 00010000:00010000:3.0:1790740246.413263:0:5828:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d09c8e22/0xc6b31a1b598e9923 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598e991c expref: 14 pid: 5835 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740246.413273:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790740246.413278:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000b2af1073 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+14:3303:x1877727158211456:12345-0@lo:103: 00010000:00010000:3.0:1790740246.413288:0:5828:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740246.413292:0:5828:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000008322affd/0xc6b31a1b598e99af lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598e99a8 expref: 14 pid: 5836 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740246.413300:0:5828:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000008322affd/0xc6b31a1b598e99af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b31a1b598e99a8 expref: 14 pid: 5836 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740246.413313:0:5828:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790740246.413338:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000b2af1073 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+14:3303:x1877727158211456:12345-0@lo:103: Request processed in 60us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740246.413350:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790740246.413364:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790740246.413369:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000006c2a43e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+13:3303:x1877727158211584:12345-0@lo:103: 00010000:00010000:3.0:1790740246.413376:0:5828:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740246.413380:0:5828:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000034db2d06/0xc6b31a1b598e993f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598e9938 expref: 13 pid: 5836 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740246.413387:0:5828:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000034db2d06/0xc6b31a1b598e993f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b31a1b598e9938 expref: 13 pid: 5836 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740246.413410:0:5828:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790740246.413431:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000006c2a43e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+13:3303:x1877727158211584:12345-0@lo:103: Request processed in 63us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740246.413437:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790740246.413448:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790740246.413453:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000004422be17 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+12:3305:x1877727158211712:12345-0@lo:103: 00010000:00010000:3.0:1790740246.413473:0:5828:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740246.413477:0:5828:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d09c8e22/0xc6b31a1b598e9923 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598e991c expref: 12 pid: 5835 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740246.413485:0:5828:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d09c8e22/0xc6b31a1b598e9923 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b31a1b598e991c expref: 12 pid: 5835 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740246.413495:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000df33269c/0xc6b31a1b598e99fc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740246.413501:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000df33269c/0xc6b31a1b598e99fc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740246.413524:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000df33269c/0xc6b31a1b598e99fc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740246.413530:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000df33269c/0xc6b31a1b598e99fc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740246.413536:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000df33269c/0xc6b31a1b598e99fc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740246.413541:0:5828:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000df33269c/0xc6b31a1b598e99fc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740246.413546:0:5828:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock 00000000df33269c already unused, calling callback (000000002702e643) 00010000:00010000:3.0:1790740246.413549:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000df33269c/0xc6b31a1b598e99fc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740246.413556:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000df33269c/0xc6b31a1b598e99fc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740246.413563:0:5828:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000df33269c/0xc6b31a1b598e99fc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740246.413596:0:5828:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790740246.413622:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000004422be17 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+12:3305:x1877727158211712:12345-0@lo:103: Request processed in 170us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740246.413628:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790740246.413668:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d4d02dd1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3305:1877727158211712:0@lo:103: 00000100:00100000:3.0:1790740246.413690:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000077ebe7d0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3303:1877727158211584:0@lo:103: 00000100:00100000:3.0:1790740246.413696:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006cbd868d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3303:1877727158211456:0@lo:103: 00010000:00010000:0.0:1790740246.413903:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008322affd/0xc6b31a1b598e99af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b31a1b598e99a8 expref: 11 pid: 5836 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740246.413917:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f79eb9fc pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5835:1877727158211072:0@lo:104: 00010000:00010000:0.0:1790740246.413926:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000034db2d06/0xc6b31a1b598e993f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b31a1b598e9938 expref: 10 pid: 5836 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740246.413945:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000065924de2 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5835:1877727158211200:0@lo:104: 00010000:00010000:0.0:1790740246.413957:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d09c8e22/0xc6b31a1b598e9923 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b31a1b598e991c expref: 9 pid: 5835 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740246.413963:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f3e79df8 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5835:1877727158211328:0@lo:104: 00010000:00010000:0.0:1790740246.413978:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000df33269c/0xc6b31a1b598e99fc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740246.413986:0:5835:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000df33269c/0xc6b31a1b598e99fc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740246.413992:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000df33269c/0xc6b31a1b598e99fc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740246.413997:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000df33269c/0xc6b31a1b598e99fc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790740246.414009:0:5835:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1790740246.477725:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000088b8a80c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+8:6697:x1877727158210944:12345-0@lo:253: Request processed in 84549us (84725us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740246.477741:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790740246.478100:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000062a5cbb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:6697:1877727158210944:0@lo:253: 10000000:01000000:2.0:1790740246.478116:0:6697:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1790740246.478119:0:6697:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790740246.478121:0:6697:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790740246.478123:0:6697:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790740246.478124:0:6697:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1790740246.478125:0:6697:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790740246.478126:0:6697:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790740246.478127:0:6697:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790740246.478128:0:6697:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1790740246.478130:0:6697:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790740246.478145:0:6697:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1790740246.478164:0:6697:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000ea349c71 from lustre-OST0000 10000000:01000000:2.0:1790740246.478189:0:6697:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1790740246.478192:0:6697:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1790740246.478200:0:6697:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8f0d87f419c0 local copy 10000000:01000000:2.0:1790740246.478203:0:6697:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1790740246.478240:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: 00000000cf509cd1/0xc6b31a1b598e9a03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740246.478251:0:6697:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.158@tcp lock: 00000000cf509cd1/0xc6b31a1b598e9a03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740246.478259:0:6697:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.158@tcp lock: 00000000cf509cd1/0xc6b31a1b598e9a03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740246.478277:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000062a5cbb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:6697:1877727158211840:0@lo:101: 00000100:00100000:2.0:1790740246.478315:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740246.478422:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set 00000000711f7cdb going to sleep for 11 seconds 00000100:00100000:3.0:1790740246.478517:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158211840 00000100:00100000:3.0:1790740246.478524:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158211840 00000100:00100000:3.0:1790740246.478628:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790740246.478638:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000090737ea2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+8:6697:x1877727158211840:12345-0@lo:101: 00010000:00010000:3.0:1790740246.478651:0:5836:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740246.478663:0:5836:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000017175284/0xc6b31a1b598e9a0a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b31a1b598e9a03 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740246.478684:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000017175284/0xc6b31a1b598e9a0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b31a1b598e9a03 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740246.478694:0:5836:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000017175284/0xc6b31a1b598e9a0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e9a03 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740246.478703:0:5836:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000017175284, rc 0) 00000100:00100000:3.0:1790740246.478738:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000090737ea2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+9:6697:x1877727158211840:12345-0@lo:101: Request processed in 102us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740246.478744:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790740246.478827:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000062a5cbb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:6697:1877727158211840:0@lo:101: 00010000:00010000:2.0:1790740246.478838:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.158@tcp lock: 00000000cf509cd1/0xc6b31a1b598e9a03 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xc6b31a1b598e9a0a expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740246.478847:0:6697:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.158@tcp lock: 00000000cf509cd1/0xc6b31a1b598e9a03 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc6b31a1b598e9a0a expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740246.478945:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000062a5cbb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:6697:1877727158211968:0@lo:501: 00000100:00100000:2.0:1790740246.478970:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740246.479305:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set 00000000711f7cdb going to sleep for 11 seconds 00000100:00100000:1.0:1790740246.479379:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158211968 00000100:00100000:1.0:1790740246.479385:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158211968 00000100:00100000:1.0:1790740246.479417:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790740246.479423:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000009a3ec0c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+9:6697:x1877727158211968:12345-0@lo:501: 00000100:00100000:1.0:1790740246.479653:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000009a3ec0c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+9:6697:x1877727158211968:12345-0@lo:501: Request processed in 230us (683us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790740246.479661:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790740246.479741:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000062a5cbb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:6697:1877727158211968:0@lo:501: 10000000:01000000:2.0:1790740246.479755:0:6697:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.158@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1790740246.479804:0:6697:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.158@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1790740246.479810:0:6697:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: 00000000cf509cd1/0xc6b31a1b598e9a03 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc6b31a1b598e9a0a expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740246.480028:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: 00000000cf509cd1/0xc6b31a1b598e9a03 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc6b31a1b598e9a0a expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740246.480036:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.158@tcp lock: 00000000cf509cd1/0xc6b31a1b598e9a03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc6b31a1b598e9a0a expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740246.480060:0:6697:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1790740246.480078:0:6697:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f0d83fe1000 10000000:01000000:2.0:1790740246.480083:0:6697:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1790740246.480088:0:6697:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8f0d87f419c0 10000000:01000000:2.0:1790740246.480091:0:6697:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1790740246.480095:0:6697:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8f0d87f419c0 from 1 10000000:01000000:2.0:1790740246.480097:0:6697:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1790740246.480119:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: 00000000f5080a6e/0xc6b31a1b598e9a11 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740246.480125:0:6697:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.158@tcp lock: 00000000f5080a6e/0xc6b31a1b598e9a11 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740246.480133:0:6697:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.158@tcp lock: 00000000f5080a6e/0xc6b31a1b598e9a11 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740246.480148:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000062a5cbb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:6697:1877727158212096:0@lo:101: 00000100:00100000:2.0:1790740246.480177:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740246.480198:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c96548f2 going to sleep for 11 seconds 00010000:00010000:1.0:1790740246.480315:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790740246.480321:0:5831:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.158@tcp lock: 00000000cf509cd1/0xc6b31a1b598e9a03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xc6b31a1b598e9a0a expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740246.480328:0:5831:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock 00000000cf509cd1 already unused, calling callback (00000000e9451455) 10000000:00010000:1.0:1790740246.480331:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.158@tcp lock: 00000000cf509cd1/0xc6b31a1b598e9a03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xc6b31a1b598e9a0a expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740246.480338:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.158@tcp lock: 00000000cf509cd1/0xc6b31a1b598e9a03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xc6b31a1b598e9a0a expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790740246.480345:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.158@tcp lock: 00000000cf509cd1/0xc6b31a1b598e9a03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xc6b31a1b598e9a0a expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790740246.480350:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790740246.480369:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.158@tcp lock: 00000000cf509cd1/0xc6b31a1b598e9a03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xc6b31a1b598e9a0a expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740246.480375:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790740246.480411:0:5831:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.158@tcp lock: 00000000cf509cd1/0xc6b31a1b598e9a03 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xc6b31a1b598e9a0a expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740246.480418:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.158@tcp lock: 00000000cf509cd1/0xc6b31a1b598e9a03 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xc6b31a1b598e9a0a expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740246.480435:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740246.480437:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740246.480447:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740246.480455:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790740246.480466:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000be002527 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3305:1877727158212224:0@lo:103: 00000100:00100000:1.0:1790740246.480494:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740246.480537:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158212224 00000100:00100000:1.0:1790740246.480543:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158212224 00000100:00100000:1.0:1790740246.480609:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790740246.480617:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000001bdd5f76 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+9:3305:x1877727158212224:12345-0@lo:103: 00010000:00010000:1.0:1790740246.480628:0:5828:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740246.480639:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000017175284/0xc6b31a1b598e9a0a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc6b31a1b598e9a03 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740246.480651:0:5828:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740246.480680:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000001bdd5f76 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+8:3305:x1877727158212224:12345-0@lo:103: Request processed in 65us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740246.480687:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790740246.480718:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000be002527 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3305:1877727158212224:0@lo:103: 00000100:00100000:1.0:1790740246.480732:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158212096 00000100:00100000:1.0:1790740246.480736:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158212096 00000100:00100000:1.0:1790740246.480750:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790740246.480754:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000b7d4a865 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+8:6697:x1877727158212096:12345-0@lo:101: 00010000:00010000:1.0:1790740246.480762:0:5837:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740246.480773:0:5837:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b2718331/0xc6b31a1b598e9a18 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b31a1b598e9a11 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740246.480804:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b2718331/0xc6b31a1b598e9a18 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b31a1b598e9a11 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740246.481029:0:5837:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b2718331/0xc6b31a1b598e9a18 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e9a11 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740246.481045:0:5837:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b2718331, rc 0) 00000100:00100000:1.0:1790740246.481074:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000b7d4a865 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+9:6697:x1877727158212096:12345-0@lo:101: Request processed in 319us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740246.481080:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790740246.481219:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000062a5cbb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:6697:1877727158212096:0@lo:101: 00010000:00010000:2.0:1790740246.481237:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.158@tcp lock: 00000000f5080a6e/0xc6b31a1b598e9a11 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9a18 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740246.481245:0:6697:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.158@tcp lock: 00000000f5080a6e/0xc6b31a1b598e9a11 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598e9a18 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790740246.481260:0:6697:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.158@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1790740246.481276:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: 00000000f5080a6e/0xc6b31a1b598e9a11 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9a18 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740246.481283:0:6697:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.158@tcp lock: 00000000f5080a6e/0xc6b31a1b598e9a11 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9a18 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790740246.481290:0:6697:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1790740246.481295:0:6697:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790740246.481300:0:6697:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1790740246.481303:0:6697:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1790740246.481318:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: 0000000096c6c889/0xc6b31a1b598e9a1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740246.481325:0:6697:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.158@tcp lock: 0000000096c6c889/0xc6b31a1b598e9a1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740246.481331:0:6697:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.158@tcp lock: 0000000096c6c889/0xc6b31a1b598e9a1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740246.481344:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000062a5cbb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:6697:1877727158212352:0@lo:101: 00000100:00100000:2.0:1790740246.481370:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740246.481387:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c96548f2 going to sleep for 11 seconds 00000100:00100000:1.0:1790740246.481450:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158212352 00000100:00100000:1.0:1790740246.481455:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158212352 00000100:00100000:1.0:1790740246.481472:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790740246.481477:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000078142828 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+9:6697:x1877727158212352:12345-0@lo:101: 00010000:00010000:1.0:1790740246.481486:0:5837:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740246.481493:0:5837:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003393d045/0xc6b31a1b598e9a26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b31a1b598e9a1f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740246.481504:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003393d045/0xc6b31a1b598e9a26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b31a1b598e9a1f expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740246.481512:0:5837:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003393d045/0xc6b31a1b598e9a26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e9a1f expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740246.481518:0:5837:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003393d045, rc 0) 00000100:00100000:1.0:1790740246.481551:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000078142828 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+10:6697:x1877727158212352:12345-0@lo:101: Request processed in 74us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740246.481556:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790740246.481642:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000062a5cbb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:6697:1877727158212352:0@lo:101: 00010000:00010000:2.0:1790740246.481657:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.158@tcp lock: 0000000096c6c889/0xc6b31a1b598e9a1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9a26 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740246.481664:0:6697:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.158@tcp lock: 0000000096c6c889/0xc6b31a1b598e9a1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598e9a26 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740246.481744:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000062a5cbb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:6697:1877727158212480:0@lo:501: 00000100:00100000:2.0:1790740246.481767:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740246.482094:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c96548f2 going to sleep for 11 seconds 00000100:00100000:1.0:1790740246.482142:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158212480 00000100:00100000:1.0:1790740246.482147:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158212480 00000100:00100000:1.0:1790740246.482167:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790740246.482173:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000aa0a5494 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+10:6697:x1877727158212480:12345-0@lo:501: 00000100:00100000:1.0:1790740246.482381:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000aa0a5494 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+10:6697:x1877727158212480:12345-0@lo:501: Request processed in 209us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740246.482403:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790740246.482526:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000062a5cbb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:6697:1877727158212480:0@lo:501: 00000100:00100000:2.0:1790740246.482556:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000062a5cbb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:6697:1877727158212608:0@lo:503: 00000100:00100000:2.0:1790740246.482618:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740246.482632:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c96548f2 going to sleep for 11 seconds 00000100:00100000:1.0:1790740246.482694:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158212608 00000100:00100000:1.0:1790740246.482698:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158212608 00000100:00100000:1.0:1790740246.482758:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790740246.482764:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000084cf4322 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+10:6697:x1877727158212608:12345-0@lo:503: 00000100:00100000:1.0:1790740246.483217:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000084cf4322 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+10:6697:x1877727158212608:12345-0@lo:503: Request processed in 453us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740246.483225:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790740246.483331:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000062a5cbb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:6697:1877727158212608:0@lo:503: 00000040:00080000:2.0:1790740246.483596:0:6697:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790740246.483667:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000062a5cbb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:6697:1877727158212736:0@lo:502: 00000100:00100000:2.0:1790740246.483703:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740246.484204:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c96548f2 going to sleep for 11 seconds 00000100:00100000:3.0:1790740246.484240:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158212736 00000100:00100000:3.0:1790740246.484247:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158212736 00000100:00100000:3.0:1790740246.484276:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790740246.484282:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000020c5b272 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+10:6697:x1877727158212736:12345-0@lo:502: 00000100:00100000:3.0:1790740246.484493:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000020c5b272 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+10:6697:x1877727158212736:12345-0@lo:502: Request processed in 211us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740246.484500:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790740246.485100:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000062a5cbb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:6697:1877727158212736:0@lo:502: 00000040:00080000:2.0:1790740246.485371:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1790740246.485449:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1790740246.485484:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1790740246.485544:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1790740246.486107:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1790740246.486149:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1790740246.486187:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000062a5cbb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:6697:1877727158212864:0@lo:502: 00000100:00100000:2.0:1790740246.486254:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740246.486332:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c96548f2 going to sleep for 11 seconds 00000100:00100000:3.0:1790740246.486374:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158212864 00000100:00100000:3.0:1790740246.486382:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158212864 00000100:00100000:3.0:1790740246.486465:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790740246.486473:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000052e0951e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+10:6697:x1877727158212864:12345-0@lo:502: 00000100:00100000:3.0:1790740246.486664:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000052e0951e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+10:6697:x1877727158212864:12345-0@lo:502: Request processed in 192us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740246.486672:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790740246.486754:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000062a5cbb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:6697:1877727158212864:0@lo:502: 00000040:00080000:2.0:1790740246.486884:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1790740246.486893:0:6697:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:2.0:1790740246.487747:0:6716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790740246.487757:0:6716:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1790740246.487764:0:6716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790740246.487766:0:6716:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1790740246.487770:0:6716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790740246.487795:0:6716:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (000000004467361c) 00000020:00000080:2.0:1790740246.487872:0:6716:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1790740246.487881:0:6716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1790740246.488086:0:6716:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ea349c71 from lustre-OST0000, refs=2 00080000:01000000:2.0:1790740246.488096:0:6716:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1790740246.488103:0:6716:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc6b31a1b598e9a34 00010000:00010000:2.0:1790740246.494429:0:6716:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1790740246.494857:0:6716:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1790740246.498850:0:6716:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1790740246.499352:0:6716:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1790740246.510202:0:6716:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1790740246.510690:0:6716:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1790740246.519203:0:6716:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1790740246.519217:0:6716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790740246.519224:0:6716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740246.519226:0:6716:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1790740246.519230:0:6716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790740246.519234:0:6716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740246.519235:0:6716:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790740246.519238:0:6716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790740246.519239:0:6716:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1790740246.519296:0:6716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790740246.519299:0:6716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740246.519301:0:6716:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:1.0:1790740246.519303:0:6716:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1790740246.520040:0:6697:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1790740246.520067:0:6697:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.158@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1790740246.520154:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: 0000000096c6c889/0xc6b31a1b598e9a1f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9a26 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740246.520169:0:6697:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.158@tcp lock: 0000000096c6c889/0xc6b31a1b598e9a1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9a26 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790740246.520177:0:6697:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f0d83fe1000 from 1 10000000:01000000:2.0:1790740246.520180:0:6697:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790740246.520224:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: 000000006f4174d4/0xc6b31a1b598e9a3b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740246.520232:0:6697:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.158@tcp lock: 000000006f4174d4/0xc6b31a1b598e9a3b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740246.520243:0:6697:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.158@tcp lock: 000000006f4174d4/0xc6b31a1b598e9a3b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740246.520266:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000062a5cbb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:6697:1877727158212992:0@lo:101: 00000100:00100000:2.0:1790740246.520331:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740246.520368:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158212992 00000100:00100000:2.0:1790740246.520373:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set 000000009b6bfb44 going to sleep for 11 seconds 00000100:00100000:0.0:1790740246.520377:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158212992 00000100:00100000:0.0:1790740246.520433:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790740246.520442:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000672ac725 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+10:6697:x1877727158212992:12345-0@lo:101: 00010000:00010000:0.0:1790740246.520456:0:5835:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740246.520470:0:5835:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000df33269c/0xc6b31a1b598e9a42 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b31a1b598e9a3b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740246.520493:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000df33269c/0xc6b31a1b598e9a42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b31a1b598e9a3b expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740246.520513:0:5835:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000df33269c/0xc6b31a1b598e9a42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e9a3b expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740246.520522:0:5835:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000df33269c, rc 0) 00000100:00100000:0.0:1790740246.520568:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000672ac725 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+11:6697:x1877727158212992:12345-0@lo:101: Request processed in 128us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740246.520595:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790740246.520688:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000062a5cbb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:6697:1877727158212992:0@lo:101: 00010000:00010000:2.0:1790740246.520700:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.158@tcp lock: 000000006f4174d4/0xc6b31a1b598e9a3b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9a42 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740246.520708:0:6697:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.158@tcp lock: 000000006f4174d4/0xc6b31a1b598e9a3b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598e9a42 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740246.520941:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000062a5cbb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:6697:1877727158213120:0@lo:501: 00000100:00100000:2.0:1790740246.520967:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740246.520995:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set 000000009b6bfb44 going to sleep for 11 seconds 00000100:00100000:0.0:1790740246.521044:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158213120 00000100:00100000:0.0:1790740246.521049:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158213120 00000100:00100000:0.0:1790740246.521078:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790740246.521085:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000015047b08 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+11:6697:x1877727158213120:12345-0@lo:501: 00000100:00100000:0.0:1790740246.521500:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000015047b08 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+11:6697:x1877727158213120:12345-0@lo:501: Request processed in 415us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740246.521508:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790740246.521974:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000062a5cbb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:6697:1877727158213120:0@lo:501: 00000100:00100000:2.0:1790740246.522012:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000062a5cbb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:6697:1877727158213248:0@lo:503: 00000100:00100000:2.0:1790740246.522214:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740246.522246:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set 000000009b6bfb44 going to sleep for 11 seconds 00000100:00100000:0.0:1790740246.522413:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158213248 00000100:00100000:0.0:1790740246.522420:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158213248 00000100:00100000:0.0:1790740246.522455:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790740246.522461:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000005dd10cce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+11:6697:x1877727158213248:12345-0@lo:503: 00000100:00100000:0.0:1790740246.522712:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000005dd10cce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+11:6697:x1877727158213248:12345-0@lo:503: Request processed in 251us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740246.522719:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790740246.522896:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000062a5cbb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:6697:1877727158213248:0@lo:503: 00000040:00080000:2.0:1790740246.523611:0:6697:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790740246.523714:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000062a5cbb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:6697:1877727158213376:0@lo:502: 00000100:00100000:2.0:1790740246.523759:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740246.523792:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set 000000009b6bfb44 going to sleep for 11 seconds 00000100:00100000:0.0:1790740246.523862:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158213376 00000100:00100000:0.0:1790740246.523870:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158213376 00000100:00100000:0.0:1790740246.523905:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790740246.523912:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000899e8a1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+11:6697:x1877727158213376:12345-0@lo:502: 00000100:00100000:0.0:1790740246.524089:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000899e8a1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+11:6697:x1877727158213376:12345-0@lo:502: Request processed in 177us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740246.524102:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790740246.524363:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000062a5cbb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:6697:1877727158213376:0@lo:502: 00000040:00080000:3.0:1790740246.524680:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1790740246.524728:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1790740246.524752:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006cbd868d pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:6697:1877727158213504:0@lo:502: 00000100:00100000:3.0:1790740246.524803:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740246.524830:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set 000000004d6faf90 going to sleep for 11 seconds 00000100:00100000:2.0:1790740246.525000:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158213504 00000100:00100000:2.0:1790740246.525006:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158213504 00000100:00100000:2.0:1790740246.525041:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790740246.525048:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000019c967d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+11:6697:x1877727158213504:12345-0@lo:502: 00000100:00100000:2.0:1790740246.525185:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000019c967d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+11:6697:x1877727158213504:12345-0@lo:502: Request processed in 138us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740246.525193:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790740246.525237:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006cbd868d pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:6697:1877727158213504:0@lo:502: 00000040:00080000:2.0:1790740246.525968:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1790740246.525981:0:6697:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1790740246.526534:0:6720:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790740246.526541:0:6720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790740246.526543:0:6720:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1790740246.526548:0:6720:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f0d83fe1000 00000020:00000080:2.0:1790740246.526550:0:6720:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790740246.527133:0:6720:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790740246.527140:0:6720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790740246.527142:0:6720:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1790740246.527145:0:6720:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1790740246.527270:0:6697:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1790740246.527290:0:6697:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790740246.527312:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3800/0xc6b31a1b598e9a3b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9a42 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740246.527324:0:6697:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3800/0xc6b31a1b598e9a3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9a42 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790740246.527357:0:6697:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1790740246.527359:0:6697:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f0d83fe1000 10000000:01000000:2.0:1790740246.527362:0:6697:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f0d83fe1000 10000000:01000000:2.0:1790740246.527372:0:6697:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790740246.527377:0:6697:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f0d83fe1000 from 1 10000000:01000000:2.0:1790740246.527380:0:6697:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790740246.527422:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3000/0xc6b31a1b598e9a49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740246.527430:0:6697:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3000/0xc6b31a1b598e9a49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740246.527441:0:6697:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3000/0xc6b31a1b598e9a49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740246.527461:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db6dc0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:6697:1877727158213632:0@lo:101: 00000100:00100000:2.0:1790740246.527510:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740246.527537:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0dc1d02f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790740246.527822:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158213632 00000100:00100000:0.0:1790740246.527830:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158213632 00000100:00100000:0.0:1790740246.527873:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790740246.527882:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+11:6697:x1877727158213632:12345-0@lo:101: 00010000:00010000:0.0:1790740246.527895:0:5835:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740246.527909:0:5835:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0d9fea6800/0xc6b31a1b598e9a50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b31a1b598e9a49 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740246.527934:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0d9fea6800/0xc6b31a1b598e9a50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b31a1b598e9a49 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740246.527944:0:5835:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0d9fea6800/0xc6b31a1b598e9a50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e9a49 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740246.527951:0:5835:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9fea6800, rc 0) 00000100:00100000:0.0:1790740246.528034:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+12:6697:x1877727158213632:12345-0@lo:101: Request processed in 153us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740246.528041:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1790740246.529049:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db6dc0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:6697:1877727158213632:0@lo:101: 00010000:00010000:3.0:1790740246.529068:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3000/0xc6b31a1b598e9a49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9a50 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740246.529079:0:6697:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3000/0xc6b31a1b598e9a49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598e9a50 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740246.529183:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db5a6b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:6697:1877727158213760:0@lo:501: 00000100:00100000:3.0:1790740246.529223:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740246.529313:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0c84c11e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790740246.530051:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158213760 00000100:00100000:0.0:1790740246.530059:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158213760 00000100:00100000:0.0:1790740246.530139:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790740246.530150:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+12:6697:x1877727158213760:12345-0@lo:501: 00000100:00100000:0.0:1790740246.530479:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+12:6697:x1877727158213760:12345-0@lo:501: Request processed in 331us (1255us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740246.530487:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790740246.530556:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db5a6b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:6697:1877727158213760:0@lo:501: 00000100:00100000:3.0:1790740246.530622:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db5a6b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:6697:1877727158213888:0@lo:503: 00000100:00100000:3.0:1790740246.530662:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740246.530840:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0c84c11e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790740246.530972:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158213888 00000100:00100000:2.0:1790740246.530978:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158213888 00000100:00100000:2.0:1790740246.531002:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790740246.531010:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+12:6697:x1877727158213888:12345-0@lo:503: 00000100:00100000:2.0:1790740246.531165:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+12:6697:x1877727158213888:12345-0@lo:503: Request processed in 156us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740246.531172:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790740246.531369:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db5a6b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:6697:1877727158213888:0@lo:503: 00000040:00080000:3.0:1790740246.531773:0:6697:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790740246.531964:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db5a6b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:6697:1877727158214016:0@lo:502: 00000100:00100000:3.0:1790740246.532006:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740246.532039:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0c84c11e40 going to sleep for 11 seconds 00000100:00100000:1.0:1790740246.532278:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158214016 00000100:00100000:1.0:1790740246.532285:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158214016 00000100:00100000:1.0:1790740246.532324:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790740246.532333:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+12:6697:x1877727158214016:12345-0@lo:502: 00000100:00100000:1.0:1790740246.532531:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+12:6697:x1877727158214016:12345-0@lo:502: Request processed in 199us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740246.532538:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790740246.532559:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db5a6b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:6697:1877727158214016:0@lo:502: 00000040:00080000:3.0:1790740246.533177:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1790740246.533213:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1790740246.533229:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1790740246.533253:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1790740246.533284:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1790740246.533329:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1790740246.533351:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1790740246.533367:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1790740246.533389:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1790740246.533438:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1790740246.533470:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1790740246.533514:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1790740246.533548:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1790740246.533668:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1790740246.533729:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1790740246.533768:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1790740246.533831:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1790740246.533901:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1790740246.534419:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1790740246.534456:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1790740246.534509:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1790740246.534567:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1790740246.534692:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1790740246.534865:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1790740246.534905:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1790740246.535201:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1790740246.535277:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1790740246.535317:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:3.0:1790740246.535365:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db5a6b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:6697:1877727158214144:0@lo:502: 00000100:00100000:3.0:1790740246.535446:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740246.535511:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0c84c11e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790740246.535527:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158214144 00000100:00100000:2.0:1790740246.535535:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158214144 00000100:00100000:0.0:1790740246.535708:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790740246.535846:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+12:6697:x1877727158214144:12345-0@lo:502: 00000100:00100000:3.0:1790740246.536214:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+12:6697:x1877727158214144:12345-0@lo:502: Request processed in 496us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740246.536222:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790740246.536336:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db5a6b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:6697:1877727158214144:0@lo:502: 00000040:00080000:0.0:1790740246.536435:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1790740246.536445:0:6697:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1790740246.538470:0:6721:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1790740246.538499:0:6721:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8f0db5a70000) 00000020:00000080:1.0:1790740246.538518:0:6721:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1790740246.538604:0:6721:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f0d83fe1000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1790740246.538608:0:6721:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f0d83fe1000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1790740246.538610:0:6721:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f0d83fe1000 3 00010000:00080000:1.0:1790740246.538637:0:6721:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f0c84c1b000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.158@tcp at head 00010000:00010000:1.0:1790740246.541556:0:6721:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:0.0:1790740246.542155:0:6721:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1790740246.542195:0:6721:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1790740246.542207:0:6721:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xc6b31a1b598e9a5e 00000100:00080000:0.0:1790740246.542217:0:6721:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790740246.542227:0:6721:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8f0c84c1b000 using connection 192.168.203.158@tcp/0@lo 00000100:00100000:0.0:1790740246.542271:0:6721:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f0dc0962a00 x1877727158214272/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790740246.542298:0:6721:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1790740246.542357:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc0960700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877727158214400:0@lo:400: 00000100:00100000:0.0:1790740246.542422:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740246.542667:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc0962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1877727158214272:0@lo:38: 00000100:00100000:2.0:1790740246.542702:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740246.542750:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158214400 00000100:00100000:2.0:1790740246.542756:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158214400 00000100:00100000:2.0:1790740246.543195:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158214272 00000100:00100000:2.0:1790740246.543200:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158214272 00000100:00100000:2.0:1790740246.543228:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790740246.543237:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc0960000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877727158214400:12345-0@lo:400: 00000100:00100000:2.0:1790740246.543303:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc0960000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877727158214400:12345-0@lo:400: Request processed in 68us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740246.543310:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790740246.543325:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790740246.543330:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db6dc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3302:x1877727158214272:12345-0@lo:38: 00010000:00080000:2.0:1790740246.543349:0:5843:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 162 last 0 00000020:00000080:2.0:1790740246.543377:0:5843:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xc6b31a1b598e9a65 00000004:00100000:2.0:1790740246.543401:0:5843:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1790740246.543429:0:5843:0:(import.c:65:import_set_state_nolock()) ffff8f0db7a31800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790740246.543465:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db6dc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877727158214272:12345-0@lo:38: Request processed in 133us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740246.543471:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1790740246.543508:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8f0dc0962a00 x1877727158214272/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790740256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740246.543518:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790740246.543525:0:3302:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1790740246.543531:0:3302:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1790740246.543535:0:3302:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1790740246.543537:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8f0c84c1b000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790740246.543542:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc0962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1877727158214272:0@lo:38: 00010000:00080000:2.0:1790740246.543569:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8f0dc0960700 x1877727158214400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740246.543604:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc0960700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877727158214400:0@lo:400: 00000040:00080000:0.0:1790740246.544069:0:6721:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:1.0:1790740246.545325:0:6697:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1790740246.545350:0:6697:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790740246.545372:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3000/0xc6b31a1b598e9a49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9a50 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740246.545384:0:6697:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3000/0xc6b31a1b598e9a49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9a50 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1790740246.545434:0:6697:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1790740246.545437:0:6697:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790740246.545438:0:6697:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790740246.545439:0:6697:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790740246.545441:0:6697:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790740246.545442:0:6697:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790740246.545443:0:6697:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790740246.545445:0:6697:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790740246.545447:0:6697:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790740246.545448:0:6697:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790740246.545449:0:6697:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790740246.545453:0:6697:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1790740246.545455:0:6697:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790740246.545457:0:6697:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790740246.545458:0:6697:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790740246.545459:0:6697:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790740246.545460:0:6697:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790740246.545461:0:6697:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790740246.545462:0:6697:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790740246.545463:0:6697:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790740246.545467:0:6697:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790740246.545468:0:6697:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790740246.545469:0:6697:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790740246.545490:0:6697:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1790740246.545504:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d8812d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:6697:1877727158214528:0@lo:253: 00000100:00100000:1.0:1790740246.545553:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740246.545604:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158214528 00000100:00100000:1.0:1790740246.545609:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158214528 00000100:00100000:1.0:1790740246.545643:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790740246.545649:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+12:6697:x1877727158214528:12345-0@lo:253: 20000000:01000000:1.0:1790740246.545684:0:5837:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1790740246.545697:0:5837:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1790740246.547072:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0db66906c0 going to sleep for 11 seconds 20000000:01000000:2.0:1790740246.579568:0:5837:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1790740246.579602:0:5837:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1790740246.579702:0:5858:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1790740246.579707:0:5858:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1790740246.579728:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f0d9fea7200/0xc6b31a1b598e9a6c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740246.579748:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0d9fea7600/0xc6b31a1b598e99d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e99d2 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740246.579757:0:5858:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f0d9fea7200/0xc6b31a1b598e9a6c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740246.579867:0:5858:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0d9fea7600/0xc6b31a1b598e99d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b31a1b598e99d2 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740246.579901:0:5858:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f0d9fea7600/0xc6b31a1b598e99d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b31a1b598e99d2 expref: 12 pid: 5835 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740246.579977:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc0961500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1877727158214656:0@lo:104: 00000100:00100000:0.0:1790740246.580042:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740246.580145:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158214656 00000100:00100000:3.0:1790740246.580153:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158214656 00000100:00100000:3.0:1790740246.580189:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790740246.580196:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc0963480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+3:5858:x1877727158214656:12345-0@lo:104: 00010000:00010000:3.0:1790740246.580207:0:5826:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499800/0xc6b31a1b598e99d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598e99d9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740246.580261:0:5826:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790740246.580267:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc0963480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+3:5858:x1877727158214656:12345-0@lo:104: Request processed in 72us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740246.580273:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1790740246.580298:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740246.580304:0:5832:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499800/0xc6b31a1b598e99d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598e99d9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740246.580323:0:5832:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f499800 already unused, calling callback (ffffffffc1baec20) 10000000:00010000:3.0:1790740246.580327:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499800/0xc6b31a1b598e99d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b31a1b598e99d9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740246.580335:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499800/0xc6b31a1b598e99d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b31a1b598e99d9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790740246.580342:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499800/0xc6b31a1b598e99d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b31a1b598e99d9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740246.580347:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1790740246.580375:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499800/0xc6b31a1b598e99d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e99d9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740246.580381:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790740246.580409:0:5832:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499800/0xc6b31a1b598e99d2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e99d9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740246.580416:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499800/0xc6b31a1b598e99d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e99d9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740246.580432:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740246.580434:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740246.580435:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740246.580442:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790740246.580453:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db5a68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3303:1877727158214784:0@lo:103: 00000100:00100000:3.0:1790740246.580481:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740246.580519:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d83e2d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790740246.580539:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc0961500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1877727158214656:0@lo:104: 00010000:00010000:0.0:1790740246.580555:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f0d9fea7200/0xc6b31a1b598e9a6c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740246.582352:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158214784 00000100:00100000:2.0:1790740246.582365:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158214784 00010000:00010000:2.0:1790740246.582407:0:5830:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0d9fea7600/0xc6b31a1b598e99d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598e99d2 expref: 13 pid: 5835 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740246.582440:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790740246.582450:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d87400050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+13:3303:x1877727158214784:12345-0@lo:103: 00010000:00010000:2.0:1790740246.582463:0:5830:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740246.582468:0:5830:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0d9fea7600/0xc6b31a1b598e99d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598e99d2 expref: 13 pid: 5835 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740246.582481:0:5830:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0d9fea7600/0xc6b31a1b598e99d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b31a1b598e99d2 expref: 13 pid: 5835 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740246.582496:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0d9fea7600/0xc6b31a1b598e99d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b31a1b598e99d2 expref: 13 pid: 5835 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740246.582511:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f0d9fea7200/0xc6b31a1b598e9a6c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740246.582520:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0d9fea7200/0xc6b31a1b598e9a6c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790740246.582535:0:5830:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004072871s 00010000:00010000:2.0:1790740246.582540:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f0d9fea7200/0xc6b31a1b598e9a6c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740246.582547:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f0d9fea7200/0xc6b31a1b598e9a6c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740246.582588:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f0d9fea7200/0xc6b31a1b598e9a6c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740246.582596:0:5830:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f0d9fea7200/0xc6b31a1b598e9a6c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740246.582603:0:5830:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9fea7200 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:2.0:1790740246.582607:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f0d9fea7200/0xc6b31a1b598e9a6c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740246.582615:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f0d9fea7200/0xc6b31a1b598e9a6c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740246.582630:0:5830:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f0d9fea7200/0xc6b31a1b598e9a6c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740246.582641:0:5830:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790740246.582693:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d87400050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+12:3303:x1877727158214784:12345-0@lo:103: Request processed in 244us (2209us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740246.582701:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1790740246.582880:0:5858:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f0d9fea7200/0xc6b31a1b598e9a6c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740246.582890:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f0d9fea7200/0xc6b31a1b598e9a6c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740246.582896:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0d9fea7200/0xc6b31a1b598e9a6c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740246.583077:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db5a68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3303:1877727158214784:0@lo:103: 00000100:00100000:2.0:1790740246.589966:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+11:6697:x1877727158214528:12345-0@lo:253: Request processed in 44307us (44403us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740246.589980:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790740246.590117:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d8812d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:6697:1877727158214528:0@lo:253: 10000000:01000000:0.0:1790740246.590132:0:6697:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1790740246.590136:0:6697:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790740246.590137:0:6697:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790740246.590139:0:6697:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790740246.590140:0:6697:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790740246.590141:0:6697:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790740246.590142:0:6697:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790740246.590144:0:6697:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790740246.590145:0:6697:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790740246.590147:0:6697:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790740246.590162:0:6697:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790740246.590163:0:6697:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1790740246.590178:0:6697:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1790740246.596773:0:6697:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1790740246.597550:0:6697:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1790740246.597979:0:6697:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1790740246.598157:0:6697:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1790740246.598474:0:6697:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1790740246.598794:0:6697:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1790740246.600213:0:6697:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1790740246.811006:0:6697:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1790740246.811014:0:6697:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1790740246.811048:0:6697:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1790740246.811100:0:6697:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.158@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1790740246.811115:0:6697:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1790740246.811143:0:6697:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1790740246.834859:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740247.858829:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790740248.432678:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1790740248.432686:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f0d85311800 from 21 10000000:01000000:0.0:1790740248.432691:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790740248.432738:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7800/0xc6b31a1b598e9a73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740248.432750:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7800/0xc6b31a1b598e9a73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740248.432761:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7800/0xc6b31a1b598e9a73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740248.432786:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc0961500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158214912:0@lo:101: 00000100:00100000:0.0:1790740248.432852:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740248.432927:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d9006ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1790740248.433183:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158214912 00000100:00100000:3.0:1790740248.433191:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158214912 00000100:00100000:3.0:1790740248.433293:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790740248.433303:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+11:5841:x1877727158214912:12345-0@lo:101: 00010000:00010000:3.0:1790740248.433314:0:5835:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740248.433327:0:5835:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0d9f499800/0xc6b31a1b598e9a7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b31a1b598e9a73 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740248.433351:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0d9f499800/0xc6b31a1b598e9a7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b31a1b598e9a73 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740248.433361:0:5835:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0d9f499800/0xc6b31a1b598e9a7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e9a73 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740248.433371:0:5835:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9f499800, rc 0) 00000100:00100000:3.0:1790740248.433432:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+12:5841:x1877727158214912:12345-0@lo:101: Request processed in 131us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740248.433439:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790740248.433529:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc0961500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158214912:0@lo:101: 00010000:00010000:0.0:1790740248.433543:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7800/0xc6b31a1b598e9a73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9a7a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740248.433552:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7800/0xc6b31a1b598e9a73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598e9a7a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740248.433641:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc0961500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158215040:0@lo:501: 00000100:00100000:0.0:1790740248.433666:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740248.438875:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158215040 00000100:00100000:1.0:1790740248.438892:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158215040 00000100:00100000:1.0:1790740248.438940:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790740248.438950:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+12:5841:x1877727158215040:12345-0@lo:501: 00000100:00100000:1.0:1790740248.439891:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+12:5841:x1877727158215040:12345-0@lo:501: Request processed in 939us (6220us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740248.439901:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790740248.442439:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d9006ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1790740248.442479:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc0961500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158215040:0@lo:501: 00000100:00100000:0.0:1790740248.442536:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc0961500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158215168:0@lo:503: 00000100:00100000:0.0:1790740248.442627:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740248.442733:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158215168 00000100:00100000:3.0:1790740248.442739:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158215168 00000100:00100000:3.0:1790740248.442778:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1790740248.442787:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+12:5841:x1877727158215168:12345-0@lo:503: 00000100:00100000:3.0:1790740248.443821:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+12:5841:x1877727158215168:12345-0@lo:503: Request processed in 1031us (1190us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740248.443832:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790740248.447132:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d9006ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1790740248.447185:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc0961500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158215168:0@lo:503: 00000100:00100000:2.0:1790740248.448234:0:6804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db6dc0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:6804:1877727158215296:0@lo:502: 00000100:00100000:2.0:1790740248.448309:0:6804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740248.448345:0:6804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0dc1d02900 going to sleep for 11 seconds 00000100:00100000:1.0:1790740248.448405:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158215296 00000100:00100000:1.0:1790740248.448413:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158215296 00000100:00100000:1.0:1790740248.448452:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790740248.448462:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+12:6804:x1877727158215296:12345-0@lo:502: 00000100:00100000:1.0:1790740248.448780:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+12:6804:x1877727158215296:12345-0@lo:502: Request processed in 320us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740248.448788:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790740248.448961:0:6804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db6dc0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:6804:1877727158215296:0@lo:502: 00000100:00100000:2.0:1790740248.449011:0:6804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db6dc0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:6804:1877727158215424:0@lo:502: 00000100:00100000:2.0:1790740248.449048:0:6804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740248.449075:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158215424 00000100:00100000:2.0:1790740248.449076:0:6804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0dc1d02900 going to sleep for 11 seconds 00000100:00100000:3.0:1790740248.449081:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158215424 00000100:00100000:3.0:1790740248.449124:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790740248.449132:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+12:6804:x1877727158215424:12345-0@lo:502: 00000100:00100000:3.0:1790740248.449293:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+12:6804:x1877727158215424:12345-0@lo:502: Request processed in 162us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740248.449299:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1790740248.449480:0:6804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db6dc0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:6804:1877727158215424:0@lo:502: 00000040:00080000:2.0:1790740248.449502:0:6804:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1790740248.449693:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1790740248.449711:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790740248.449721:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7800/0xc6b31a1b598e9a73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9a7a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740248.449733:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7800/0xc6b31a1b598e9a73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9a7a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740248.449743:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790740248.449745:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f0d85311800 from 4 10000000:01000000:0.0:1790740248.449748:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790740248.449776:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea6200/0xc6b31a1b598e9a81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740248.449784:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea6200/0xc6b31a1b598e9a81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740248.449794:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea6200/0xc6b31a1b598e9a81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740248.449816:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc0961500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158215552:0@lo:101: 00000100:00100000:0.0:1790740248.449908:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740248.449968:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d9006ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1790740248.450311:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158215552 00000100:00100000:2.0:1790740248.450316:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158215552 00000100:00100000:2.0:1790740248.450396:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790740248.450405:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+12:5841:x1877727158215552:12345-0@lo:101: 00010000:00010000:2.0:1790740248.450417:0:5837:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740248.450430:0:5837:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0dc21d3400/0xc6b31a1b598e9a88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b31a1b598e9a81 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740248.450452:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0dc21d3400/0xc6b31a1b598e9a88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b31a1b598e9a81 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740248.450463:0:5837:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0dc21d3400/0xc6b31a1b598e9a88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e9a81 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740248.450471:0:5837:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0dc21d3400, rc 0) 00000100:00100000:2.0:1790740248.450513:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+13:5841:x1877727158215552:12345-0@lo:101: Request processed in 109us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740248.450520:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1790740248.450600:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc0961500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158215552:0@lo:101: 00010000:00010000:0.0:1790740248.450611:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea6200/0xc6b31a1b598e9a81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9a88 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740248.450620:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea6200/0xc6b31a1b598e9a81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598e9a88 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740248.450665:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc0961500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158215680:0@lo:256: 00000100:00100000:0.0:1790740248.450691:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740248.450967:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d9006ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1790740248.451014:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158215680 00000100:00100000:1.0:1790740248.451019:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158215680 00000100:00100000:1.0:1790740248.451048:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1790740248.451054:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d874ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+13:5841:x1877727158215680:12345-0@lo:256: 20000000:01000000:1.0:1790740248.451068:0:5836:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1790740248.451082:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790740248.451085:0:5836:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1790740248.451279:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d874ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+13:5841:x1877727158215680:12345-0@lo:256: Request processed in 225us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740248.451286:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790740248.451341:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc0961500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158215680:0@lo:256: 10000000:01000000:0.0:1790740248.451386:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790740248.451392:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea6200/0xc6b31a1b598e9a81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9a88 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740248.451399:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea6200/0xc6b31a1b598e9a81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9a88 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740248.451407:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1790740248.451409:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1790740248.451411:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1790740248.451430:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7000/0xc6b31a1b598e9a8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740248.451448:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7000/0xc6b31a1b598e9a8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740248.451458:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7000/0xc6b31a1b598e9a8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740248.451471:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc0961500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158215808:0@lo:101: 00000100:00100000:0.0:1790740248.451501:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740248.451710:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d9006ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1790740248.453287:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158215808 00000100:00100000:3.0:1790740248.453300:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158215808 00000100:00100000:3.0:1790740248.454840:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790740248.454862:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d874af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+13:5841:x1877727158215808:12345-0@lo:101: 00010000:00010000:3.0:1790740248.454881:0:5835:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740248.456212:0:5835:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0d9f498800/0xc6b31a1b598e9a96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b31a1b598e9a8f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740248.456257:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0d9f498800/0xc6b31a1b598e9a96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b31a1b598e9a8f expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740248.456270:0:5835:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0d9f498800/0xc6b31a1b598e9a96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e9a8f expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740248.456291:0:5835:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9f498800, rc 0) 00000100:00100000:3.0:1790740248.456370:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d874af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+14:5841:x1877727158215808:12345-0@lo:101: Request processed in 1518us (4867us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740248.456389:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790740248.457018:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc0961500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158215808:0@lo:101: 00010000:00010000:0.0:1790740248.457040:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7000/0xc6b31a1b598e9a8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9a96 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740248.457051:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7000/0xc6b31a1b598e9a8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598e9a96 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740248.457123:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc0961500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158215936:0@lo:501: 00000100:00100000:0.0:1790740248.457161:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740248.457201:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d9006ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1790740248.457370:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158215936 00000100:00100000:3.0:1790740248.457386:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158215936 00000100:00100000:3.0:1790740248.458115:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790740248.458128:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d874adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+14:5841:x1877727158215936:12345-0@lo:501: 00000100:00100000:3.0:1790740248.458417:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d874adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+14:5841:x1877727158215936:12345-0@lo:501: Request processed in 292us (1255us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740248.458431:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790740248.459666:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc0961500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158215936:0@lo:501: 00000100:00100000:0.0:1790740248.459718:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc0961500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158216064:0@lo:503: 00000100:00100000:0.0:1790740248.459775:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740248.459810:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d9006ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1790740248.459972:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158216064 00000100:00100000:1.0:1790740248.459980:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158216064 00000100:00100000:1.0:1790740248.460023:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790740248.460031:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d874ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+14:5841:x1877727158216064:12345-0@lo:503: 00000100:00100000:1.0:1790740248.460489:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d874ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+14:5841:x1877727158216064:12345-0@lo:503: Request processed in 457us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740248.460499:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790740248.462023:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc0961500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158216064:0@lo:503: 00000100:00100000:3.0:1790740248.463162:0:6807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db5a68700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:6807:1877727158216192:0@lo:502: 00000100:00100000:3.0:1790740248.463233:0:6807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740248.466779:0:6807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d8962e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790740248.467168:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158216192 00000100:00100000:1.0:1790740248.467179:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158216192 00000100:00100000:1.0:1790740248.467240:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790740248.467251:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d874ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+14:6807:x1877727158216192:12345-0@lo:502: 00000100:00100000:1.0:1790740248.467619:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d874ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+14:6807:x1877727158216192:12345-0@lo:502: Request processed in 369us (4384us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740248.467628:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790740248.468670:0:6807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db5a68700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:6807:1877727158216192:0@lo:502: 00000020:01000000:2.0:1790740248.468718:0:6807:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790740248.468727:0:6807:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1790740248.468734:0:6807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790740248.468737:0:6807:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1790740248.468743:0:6807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1790740248.468747:0:6807:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.158@tcp to nid 0x20000c0a8cb9e (192.168.203.158@tcp) 00000020:01000000:2.0:1790740248.468770:0:6807:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1790740248.468773:0:6807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790740248.468787:0:6807:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8f0dbeb4b380) 00000020:00000080:2.0:1790740248.468805:0:6807:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1790740248.468810:0:6807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1790740248.468886:0:6807:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1790740248.468892:0:6807:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:2.0:1790740248.468898:0:6807:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc6b31a1b598e9aa4 00010000:00080000:2.0:1790740248.469122:0:6807:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f0db7a36000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.158@tcp at head 00010000:00010000:2.0:1790740248.469439:0:6807:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1790740248.544052:0:6807:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1790740248.544079:0:6807:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1790740248.545182:0:6807:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790740248.545505:0:6807:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790740248.545561:0:6807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1790740248.545740:0:6807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1790740248.546504:0:6813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790740248.546510:0:6813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1790740248.549819:0:6807:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790740248.549844:0:6807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1790740248.549897:0:6807:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1790740248.549932:0:6807:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc6b31a1b598e9aab 00000100:00080000:0.0:1790740248.549942:0:6807:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790740248.549953:0:6807:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8f0db7a36000 using connection 192.168.203.158@tcp/0@lo 00000100:00100000:0.0:1790740248.549989:0:6807:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f0dc0962d80 x1877727158216320/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790740248.550015:0:6807:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1790740248.550089:0:6807:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790740248.550093:0:6807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740248.550095:0:6807:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1790740248.550098:0:6807:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790740248.550101:0:6807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740248.550103:0:6807:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790740248.550106:0:6807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790740248.550108:0:6807:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1790740248.550135:0:6807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc0962680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:6807:1877727158216448:0@lo:502: 00000100:00100000:3.0:1790740248.550195:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db5a69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877727158216576:0@lo:400: 00000100:00100000:0.0:1790740248.550215:0:6807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740248.550238:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740248.550292:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790740248.550298:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db5a6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1877727158216704:0@lo:400: 00000100:00100000:3.0:1790740248.550324:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740248.550361:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158216576 00000100:00100000:3.0:1790740248.550367:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158216576 00000100:00100000:3.0:1790740248.550421:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158216704 00000100:00100000:2.0:1790740248.550425:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc0962d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1877727158216320:0@lo:8: 00000100:00100000:3.0:1790740248.550426:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158216704 00000100:00100000:2.0:1790740248.550465:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740248.550507:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158216320 00000100:00100000:2.0:1790740248.550512:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158216320 00000100:00100000:2.0:1790740248.550535:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790740248.550542:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db6dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3302:x1877727158216320:12345-0@lo:8: 00010000:00080000:2.0:1790740248.550565:0:6699:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 164 last 0 00000020:00000080:2.0:1790740248.550610:0:6699:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc6b31a1b598e9ab2 00002000:00100000:2.0:1790740248.550645:0:6699:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8f0db7a30800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b03 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1790740248.550650:0:6699:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1790740248.550660:0:6699:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1790740248.550774:0:6699:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1790740248.550937:0:6699:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1790740248.550959:0:6699:0:(import.c:65:import_set_state_nolock()) ffff8f0db7a34800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790740248.551009:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db6dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3302:x1877727158216320:12345-0@lo:8: Request processed in 466us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740248.551016:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1790740248.551053:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f0dc0962d80 x1877727158216320/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790740258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740248.551063:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790740248.551070:0:3302:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1790740248.551076:0:3302:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1790740248.551080:0:3302:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1790740248.551083:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8f0db7a36000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1790740248.551092:0:3302:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1790740248.551097:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc0962d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1877727158216320:0@lo:8: 00000004:00080000:2.0:1790740248.551117:0:6813:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1790740248.551217:0:6813:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 164501643676ns, next at 0ns, rc = 0 00000100:00100000:3.0:1790740248.551223:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790740248.551232:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db5a6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877727158216576:12345-0@lo:400: 00000100:00100000:3.0:1790740248.551276:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db5a6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877727158216576:12345-0@lo:400: Request processed in 46us (1038us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740248.551283:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790740248.551300:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790740248.551306:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db5a6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877727158216704:12345-0@lo:400: 00000100:00100000:3.0:1790740248.551335:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db5a6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877727158216704:12345-0@lo:400: Request processed in 29us (1010us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740248.551341:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1790740248.551369:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790740248.551655:0:6807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d9006a900 going to sleep for 11 seconds 00010000:00080000:3.0:1790740248.551801:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f0db5a6b480 x1877727158216704/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740248.551830:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db5a6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1877727158216704:0@lo:400: 00010000:00080000:3.0:1790740248.551844:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f0db5a69500 x1877727158216576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740248.551853:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db5a69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877727158216576:0@lo:400: 00000100:00100000:2.0:1790740248.553305:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158216448 00000100:00100000:2.0:1790740248.553392:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158216448 00000100:00100000:2.0:1790740248.553443:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790740248.553453:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d874ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+14:6807:x1877727158216448:12345-0@lo:502: 00000100:00100000:2.0:1790740248.554225:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d874ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+14:6807:x1877727158216448:12345-0@lo:502: Request processed in 771us (4009us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740248.554235:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1790740248.558671:0:6807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc0962680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:6807:1877727158216448:0@lo:502: 00000020:01000000:1.0:1790740248.558728:0:6807:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790740248.558736:0:6807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740248.558739:0:6807:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:1.0:1790740248.558744:0:6807:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1790740248.560039:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1790740248.560065:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.158@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1790740248.560076:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7000/0xc6b31a1b598e9a8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9a96 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740248.560089:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7000/0xc6b31a1b598e9a8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9a96 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790740248.560098:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790740248.560100:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f0d85311800 from 1 10000000:01000000:1.0:1790740248.560103:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790740248.560139:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977800/0xc6b31a1b598e9ab9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740248.560147:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977800/0xc6b31a1b598e9ab9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740248.560157:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977800/0xc6b31a1b598e9ab9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740248.560177:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d8812ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158216832:0@lo:101: 00000100:00100000:1.0:1790740248.560242:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740248.560286:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0c81092c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790740248.560417:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158216832 00000100:00100000:2.0:1790740248.560426:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158216832 00000100:00100000:2.0:1790740248.560470:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790740248.560490:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d874ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+14:5841:x1877727158216832:12345-0@lo:101: 00010000:00010000:2.0:1790740248.560502:0:5836:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740248.560513:0:5836:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0dc21d2a00/0xc6b31a1b598e9ac0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b31a1b598e9ab9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740248.560537:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0dc21d2a00/0xc6b31a1b598e9ac0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b31a1b598e9ab9 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740248.560547:0:5836:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0dc21d2a00/0xc6b31a1b598e9ac0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e9ab9 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740248.560555:0:5836:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0dc21d2a00, rc 0) 00000100:00100000:2.0:1790740248.560619:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d874ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+15:5841:x1877727158216832:12345-0@lo:101: Request processed in 131us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740248.560626:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790740248.560788:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d8812ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158216832:0@lo:101: 00010000:00010000:1.0:1790740248.562950:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977800/0xc6b31a1b598e9ab9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9ac0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740248.562963:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977800/0xc6b31a1b598e9ab9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598e9ac0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740248.563043:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d8812ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158216960:0@lo:501: 00000100:00100000:1.0:1790740248.563098:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740248.563136:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0c81092c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790740248.563156:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158216960 00000100:00100000:1.0:1790740248.563162:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158216960 00000100:00100000:1.0:1790740248.563198:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1790740248.563207:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d874af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+15:5841:x1877727158216960:12345-0@lo:501: 00000100:00100000:1.0:1790740248.563546:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d874af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+15:5841:x1877727158216960:12345-0@lo:501: Request processed in 338us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740248.563554:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1790740248.563620:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d8812ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158216960:0@lo:501: 00000100:00100000:1.0:1790740248.563652:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d8812ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158217088:0@lo:503: 00000100:00100000:1.0:1790740248.563693:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740248.563713:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0c81092c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790740248.563727:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158217088 00000100:00100000:1.0:1790740248.563732:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158217088 00000100:00100000:1.0:1790740248.563753:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1790740248.563760:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d874ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+15:5841:x1877727158217088:12345-0@lo:503: 00000100:00100000:1.0:1790740248.566223:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d874ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+15:5841:x1877727158217088:12345-0@lo:503: Request processed in 2454us (2521us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740248.566236:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1790740248.566314:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d8812ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158217088:0@lo:503: 00000100:00100000:0.0:1790740248.571709:0:6818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc0963100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:6818:1877727158217216:0@lo:502: 00000100:00100000:0.0:1790740248.571787:0:6818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740248.572616:0:6818:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d83604cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790740248.576502:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158217216 00000100:00100000:1.0:1790740248.576516:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158217216 00000100:00100000:1.0:1790740248.576612:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790740248.576623:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d874ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+15:6818:x1877727158217216:12345-0@lo:502: 00000100:00100000:1.0:1790740248.577004:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d874ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+15:6818:x1877727158217216:12345-0@lo:502: Request processed in 382us (5215us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740248.577012:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1790740248.577067:0:6818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc0963100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:6818:1877727158217216:0@lo:502: 00000020:01000000:2.0:1790740248.577110:0:6818:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790740248.577120:0:6818:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790740248.577122:0:6818:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1790740248.577130:0:6818:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f0d85311800 00000020:00000080:2.0:1790740248.577132:0:6818:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1790740248.577167:0:6818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db6dc1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:6818:1877727158217344:0@lo:502: 00000100:00100000:2.0:1790740248.577217:0:6818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740248.577262:0:6818:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0dc1d029c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790740248.578790:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158217344 00000100:00100000:1.0:1790740248.578809:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158217344 00000100:00100000:1.0:1790740248.578861:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1790740248.578871:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d874ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+15:6818:x1877727158217344:12345-0@lo:502: 00000100:00100000:1.0:1790740248.579079:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d874ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+15:6818:x1877727158217344:12345-0@lo:502: Request processed in 209us (1862us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740248.579087:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790740248.581059:0:6818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db6dc1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:6818:1877727158217344:0@lo:502: 00000020:01000000:0.0:1790740248.581107:0:6818:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790740248.581116:0:6818:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740248.581118:0:6818:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1790740248.581124:0:6818:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1790740248.581193:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1790740248.581211:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790740248.581221:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977800/0xc6b31a1b598e9ab9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9ac0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740248.581245:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977800/0xc6b31a1b598e9ab9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9ac0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740248.581255:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1790740248.581257:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8f0d87f419c0 from 1 10000000:01000000:0.0:1790740248.581260:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1790740248.581901:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7c00/0xc6b31a1b598e9ac7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740248.581912:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7c00/0xc6b31a1b598e9ac7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740248.581923:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7c00/0xc6b31a1b598e9ac7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740248.581943:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc0963b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158217472:0@lo:101: 00000100:00100000:0.0:1790740248.582389:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740248.582504:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d83604300 going to sleep for 11 seconds 00000100:00100000:1.0:1790740248.583890:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158217472 00000100:00100000:1.0:1790740248.583901:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158217472 00000100:00100000:1.0:1790740248.583952:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1790740248.583963:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d874af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+15:5841:x1877727158217472:12345-0@lo:101: 00010000:00010000:1.0:1790740248.583980:0:5837:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740248.583997:0:5837:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0d9f976a00/0xc6b31a1b598e9ace lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b31a1b598e9ac7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740248.584024:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0d9f976a00/0xc6b31a1b598e9ace lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b31a1b598e9ac7 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740248.584035:0:5837:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0d9f976a00/0xc6b31a1b598e9ace lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e9ac7 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740248.584058:0:5837:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9f976a00, rc 0) 00000100:00100000:1.0:1790740248.584117:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d874af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+16:5841:x1877727158217472:12345-0@lo:101: Request processed in 156us (1729us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740248.584124:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790740248.584131:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc0963b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158217472:0@lo:101: 00010000:00010000:0.0:1790740248.584147:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7c00/0xc6b31a1b598e9ac7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9ace expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740248.584156:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7c00/0xc6b31a1b598e9ac7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598e9ace expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740248.584224:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc0963b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158217600:0@lo:501: 00000100:00100000:0.0:1790740248.584256:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740248.584293:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d83604300 going to sleep for 11 seconds 00000100:00100000:1.0:1790740248.584314:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158217600 00000100:00100000:1.0:1790740248.584395:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158217600 00000100:00100000:1.0:1790740248.584424:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790740248.584431:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d84877850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+16:5841:x1877727158217600:12345-0@lo:501: 00000100:00100000:1.0:1790740248.584641:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d84877850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+16:5841:x1877727158217600:12345-0@lo:501: Request processed in 210us (383us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790740248.584649:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790740248.586102:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc0963b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158217600:0@lo:501: 10000000:01000000:1.0:1790740248.586148:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.158@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1790740248.586158:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7c00/0xc6b31a1b598e9ac7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9ace expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740248.586169:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7c00/0xc6b31a1b598e9ac7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9ace expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790740248.629430:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:3.0:1790740248.629667:0:6814:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1790740248.629695:0:6814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db5a6b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6814:1877727158217856:0@lo:7: 00000100:00100000:0.0:1790740248.629851:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db5a69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158217728:0@lo:13: 00000100:00100000:3.0:1790740248.629976:0:6814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740248.630027:0:6814:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d8962e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790740248.630061:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158217856 00000100:00100000:3.0:1790740248.630068:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158217856 00000100:00100000:3.0:1790740248.630123:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790740248.630134:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db5a6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6814:x1877727158217856:12345-0@lo:7: 00000100:00100000:0.0:1790740248.630244:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740248.632686:0:6703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158217728 00000100:00100000:2.0:1790740248.632700:0:6703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158217728 00000100:00100000:2.0:1790740248.632747:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790740248.632756:0:6703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc0962300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1877727158217728:12345-0@lo:13: 00002000:00000024:2.0:1790740248.632791:0:6703:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1790740248.632873:0:6703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc0962300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1877727158217728:12345-0@lo:13: Request processed in 117us (2629us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740248.632880:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1790740248.632901:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790740248.633536:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f0db5a69500 x1877727158217728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740264 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740248.633569:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db5a69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158217728:0@lo:13: 00002000:00080000:3.0:1790740248.640213:0:6701:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1790740248.640222:0:6701:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1790740248.640385:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db5a6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6814:x1877727158217856:12345-0@lo:7: Request processed in 10240us (10395us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740248.640397:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1790740248.640501:0:6814:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f0db5a6b480 x1877727158217856/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790740264 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740248.640516:0:6814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db5a6b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6814:1877727158217856:0@lo:7: 00000004:00080000:0.0:1790740248.640530:0:6814:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1790740248.640569:0:6814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc0963b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6814:1877727158217984:0@lo:5: 00000100:00100000:1.0:1790740248.640830:0:6814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740248.640906:0:6814:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d83604a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790740248.640947:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158217984 00000100:00100000:3.0:1790740248.640954:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158217984 00000100:00100000:2.0:1790740248.644126:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790740248.644145:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8812ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6814:x1877727158217984:12345-0@lo:5: 00002000:00080000:2.0:1790740248.644180:0:6700:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1790740248.644185:0:6700:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1790740248.644623:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8812ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6814:x1877727158217984:12345-0@lo:5: Request processed in 486us (3793us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1790740248.644633:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1790740248.644692:0:6814:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f0dc0963b80 x1877727158217984/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790740264 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740248.644710:0:6814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc0963b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6814:1877727158217984:0@lo:5: 00000004:00080000:3.0:1790740248.644723:0:6814:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1790740248.644759:0:6814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db5a6bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6814:1877727158218112:0@lo:700: 00000100:00100000:3.0:1790740248.644798:0:6814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740248.644829:0:6814:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d8962ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1790740248.644850:0:6708:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158218112 00000100:00100000:3.0:1790740248.644856:0:6708:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158218112 00000100:00100000:3.0:1790740248.644884:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790740248.644890:0:6708:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db5a6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6814:x1877727158218112:12345-0@lo:700: 00000100:00100000:3.0:1790740248.644917:0:6708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db5a69500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6708:1877727158218240:0@lo:700: 00000100:00100000:3.0:1790740248.644990:0:6708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740248.645005:0:6708:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d8962e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790740248.645028:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158218240 00000100:00100000:3.0:1790740248.645031:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158218240 00000100:00100000:3.0:1790740248.645054:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790740248.645059:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db5a68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6708:x1877727158218240:12345-0@lo:700: 40000000:02000000:1.0:1790740248.689110:0:5849:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1790740248.700174:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db5a68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6708:x1877727158218240:12345-0@lo:700: Request processed in 55105us (55174us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740248.700197:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1790740248.700216:0:6708:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f0db5a69500 x1877727158218240/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1790740264 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740248.700234:0:6708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db5a69500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6708:1877727158218240:0@lo:700: 40000000:02000000:3.0:1790740248.700250:0:6708:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:3.0:1790740248.806359:0:6725:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1790740248.806371:0:6725:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1790740248.806547:0:6708:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db5a6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6814:x1877727158218112:12345-0@lo:700: Request processed in 161651us (161742us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740248.806563:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1790740248.808856:0:6814:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f0db5a6bb80 x1877727158218112/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1790740264 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740248.808871:0:6814:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1790740248.808892:0:6814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db5a6bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6814:1877727158218112:0@lo:700: 00000004:02000040:2.0:1790740248.870438:0:6814:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:2.0:1790740248.875261:0:6814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db6dc0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6814:1877727158218368:0@lo:5: 00000100:00100000:2.0:1790740248.875327:0:6814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740248.875366:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158218368 00000100:00100000:3.0:1790740248.875386:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158218368 00000100:00100000:3.0:1790740248.875449:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790740248.875466:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db6dc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6814:x1877727158218368:12345-0@lo:5: 00000100:00100000:2.0:1790740248.878756:0:6814:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d87f20240 going to sleep for 11 seconds 00010000:00010000:1.0:1790740248.883122:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1790740248.884171:0:6701:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1790740248.884190:0:6701:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:3.0:1790740248.889305:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db6dc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6814:x1877727158218368:12345-0@lo:5: Request processed in 13598us (13735us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1790740248.889321:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1790740248.889387:0:6814:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f0db6dc0000 x1877727158218368/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790740264 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740248.889404:0:6814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db6dc0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6814:1877727158218368:0@lo:5: 00000004:00080000:3.0:1790740248.889426:0:6814:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:3.0:1790740249.904817:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740250.928818:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740251.956113:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790740252.629246:0:7069:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1790740252.976737:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740254.000733:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740254.001122:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d8812e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3304:1877727158218496:0@lo:400: 00000100:00100000:3.0:1790740254.001175:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d8812e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158218880:0@lo:400: 00000100:00100000:1.0:1790740254.001195:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740254.001220:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740254.001268:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d8812f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877727158218624:0@lo:400: 00000100:00100000:3.0:1790740254.001279:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158218880 00000100:00100000:3.0:1790740254.001288:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158218880 00000100:00100000:3.0:1790740254.001347:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790740254.001358:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db5a6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1877727158218880:12345-0@lo:400: 00000100:00100000:1.0:1790740254.001362:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740254.001389:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790740254.001398:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d8812fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1877727158218752:0@lo:400: 00000100:00100000:3.0:1790740254.001426:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db5a6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1877727158218880:12345-0@lo:400: Request processed in 69us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740254.001435:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740254.001439:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790740254.001478:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158218496 00000100:00100000:1.0:1790740254.001484:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158218496 00010000:00080000:3.0:1790740254.001493:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f0d8812e300 x1877727158218880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740254.001509:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d8812e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158218880:0@lo:400: 00000100:00100000:1.0:1790740254.001516:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790740254.001526:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d84877c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+16:3304:x1877727158218496:12345-0@lo:400: 00000100:00080000:3.0:1790740254.001540:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790740254.001566:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d84877c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+16:3304:x1877727158218496:12345-0@lo:400: Request processed in 42us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740254.001596:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790740254.001603:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d8812e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3304:1877727158218496:0@lo:400: 00000100:00100000:1.0:1790740254.001632:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158218624 00000100:00100000:1.0:1790740254.001637:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158218624 00000100:00100000:1.0:1790740254.001668:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158218752 00000100:00100000:1.0:1790740254.001672:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158218752 00000100:00100000:1.0:1790740254.001695:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790740254.001702:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8812c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877727158218624:12345-0@lo:400: 00000100:00100000:1.0:1790740254.001738:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8812c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877727158218624:12345-0@lo:400: Request processed in 36us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740254.001744:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790740254.001756:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790740254.001762:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8812ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877727158218752:12345-0@lo:400: 00000100:00100000:1.0:1790740254.001789:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8812ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877727158218752:12345-0@lo:400: Request processed in 27us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740254.001807:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1790740254.001829:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1790740254.001847:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f0d8812fb80 x1877727158218752/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740254.001856:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d8812fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1877727158218752:0@lo:400: 00010000:00080000:1.0:1790740254.001865:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f0d8812f100 x1877727158218624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740254.001873:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d8812f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877727158218624:0@lo:400: 00000100:00100000:1.0:1790740254.006662:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db5a69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158219008:0@lo:13: 00000100:00100000:1.0:1790740254.006741:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740254.008774:0:6703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158219008 00000100:00100000:0.0:1790740254.008786:0:6703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158219008 00000100:00100000:0.0:1790740254.008841:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790740254.008851:0:6703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8812f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1877727158219008:12345-0@lo:13: 00002000:00000024:0.0:1790740254.008885:0:6703:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790740254.008958:0:6703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8812f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1877727158219008:12345-0@lo:13: Request processed in 108us (2216us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740254.008965:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1790740254.011236:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f0db5a69500 x1877727158219008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740270 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740254.011264:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db5a69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158219008:0@lo:13: 00000001:00080000:2.0:1790740254.064409:0:6725:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1790740255.024709:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740256.048729:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740257.072710:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740258.105055:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740259.120783:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db5a69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158219136:0@lo:13: 00000100:00100000:3.0:1790740259.120857:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740259.120968:0:6703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158219136 00000100:00100000:3.0:1790740259.120977:0:6703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158219136 00000100:00100000:3.0:1790740259.121030:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790740259.121040:0:6703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db5a69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158219136:12345-0@lo:13: 00002000:00000024:3.0:1790740259.121073:0:6703:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790740259.121121:0:6703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db5a69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158219136:12345-0@lo:13: Request processed in 83us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740259.121127:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1790740259.121151:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790740259.121178:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f0db5a69880 x1877727158219136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740275 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740259.121187:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1790740259.121206:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db5a69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158219136:0@lo:13: 00010000:00010000:1.0:1790740259.122202:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740259.129644:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790740259.129668:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc0962680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877727158219392:0@lo:400: 00000100:00100000:0.0:1790740259.129746:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740259.129797:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158219392 00000100:00100000:0.0:1790740259.129805:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158219392 00000100:00100000:0.0:1790740259.129984:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790740259.129996:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc0962d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877727158219392:12345-0@lo:400: 00000100:00100000:0.0:1790740259.130051:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc0962d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877727158219392:12345-0@lo:400: Request processed in 57us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740259.130069:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1790740259.130111:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f0dc0962680 x1877727158219392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740259.130126:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc0962680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877727158219392:0@lo:400: 00000100:00100000:0.0:1790740259.130326:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc0962680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1877727158219520:0@lo:400: 00000100:00100000:0.0:1790740259.130356:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740259.130699:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158219520 00000100:00100000:3.0:1790740259.130706:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158219520 00000100:00100000:3.0:1790740259.130764:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790740259.130774:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc0961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877727158219520:12345-0@lo:400: 00000100:00080000:0.0:1790740259.130774:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790740259.130804:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc0963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3306:1877727158219264:0@lo:400: 00000100:00100000:3.0:1790740259.130826:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc0961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877727158219520:12345-0@lo:400: Request processed in 53us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740259.130833:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1790740259.130867:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f0dc0962680 x1877727158219520/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740259.130877:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc0962680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1877727158219520:0@lo:400: 00000100:00100000:0.0:1790740259.130966:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740259.131002:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158219264 00000100:00100000:2.0:1790740259.131008:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158219264 00000100:00100000:2.0:1790740259.131047:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1790740259.131055:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d84876c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+16:3306:x1877727158219264:12345-0@lo:400: 00000100:00100000:2.0:1790740259.131100:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d84876c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+16:3306:x1877727158219264:12345-0@lo:400: Request processed in 47us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740259.131107:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790740259.131237:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc0963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3306:1877727158219264:0@lo:400: 00010000:00010000:1.0:1790740260.148672:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740261.168770:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740262.197063:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740263.216694:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1790740263.371708:0:7627:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1790740263.371712:0:7627:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1790740263.371879:0:7627:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8f0db562c800 00000020:01000004:2.0:1790740263.371895:0:7627:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1790740263.371906:0:7627:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1790740263.371927:0:7627:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8f0db6f5b380) 00000020:00000080:2.0:1790740263.371938:0:7627:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1790740263.386644:0:7627:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1790740263.386925:0:7627:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1790740263.411912:0:7627:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1790740263.417337:0:7627:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1790740263.417372:0:7627:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1790740263.417426:0:7627:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1790740263.417450:0:7627:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1790740263.417970:0:7627:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1790740263.417980:0:7627:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790740263.417989:0:7627:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc6b31a1b598e9adc 00000020:01000004:2.0:1790740263.417996:0:7627:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1790740263.418014:0:7627:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.158@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1790740263.418016:0:7627:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.158@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1790740263.418021:0:7627:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1790740263.418039:0:7627:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1790740263.418042:0:7627:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.158@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1790740263.446550:0:7627:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.158@tcp ctxt 0 is initialized 00000020:01000004:3.0:1790740263.446944:0:7627:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.158@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1790740263.446952:0:7627:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1790740263.446953:0:7627:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790740263.446955:0:7627:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790740263.446956:0:7627:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790740263.446957:0:7627:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790740263.447044:0:7627:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790740263.447046:0:7627:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790740263.447048:0:7627:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790740263.447049:0:7627:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790740263.447051:0:7627:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790740263.447052:0:7627:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790740263.447055:0:7627:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1790740263.447058:0:7627:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790740263.447059:0:7627:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790740263.447060:0:7627:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790740263.447061:0:7627:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790740263.447062:0:7627:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790740263.447063:0:7627:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790740263.447064:0:7627:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790740263.447065:0:7627:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790740263.447066:0:7627:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790740263.447067:0:7627:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790740263.447067:0:7627:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790740263.447102:0:7627:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1790740263.447119:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db5a69880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:7627:1877727158219648:0@lo:253: 00000100:00100000:3.0:1790740263.447191:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740263.447303:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0dbec320c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790740263.447420:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158219648 00000100:00100000:1.0:1790740263.447429:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158219648 00000100:00100000:1.0:1790740263.447515:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790740263.447525:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d84876850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+16:7627:x1877727158219648:12345-0@lo:253: 20000000:01000000:1.0:1790740263.447561:0:5835:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1790740263.447565:0:5835:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1790740263.447593:0:5835:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1790740263.447597:0:5835:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1790740263.448521:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790740263.448765:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1790740263.448778:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1790740263.448817:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1790740263.448825:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1790740263.448855:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1790740263.448899:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1790740263.449256:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1790740263.449287:0:5835:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.158@tcp 20000000:01000000:1.0:1790740263.449289:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.158@tcp (null) (null) (null) 00000040:00080000:1.0:1790740263.449326:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1790740263.449333:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1790740263.449381:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1790740263.449389:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.158@tcp (null) (null) 00000040:00080000:1.0:1790740263.449418:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1790740263.449426:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1790740263.449458:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1790740263.449534:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1790740263.450250:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1790740263.457723:0:5835:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.158@tcp 20000000:01000000:1.0:1790740263.457735:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.158@tcp (null) (null) (null) 00000040:00080000:1.0:1790740263.457878:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1790740263.457893:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1790740263.457926:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1790740263.457934:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.158@tcp (null) (null) 00000040:00080000:1.0:1790740263.457977:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1790740263.457987:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1790740263.458104:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1790740263.458149:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1790740263.458170:0:5835:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1790740263.458173:0:5835:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1790740263.458176:0:5835:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1790740263.458190:0:5835:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1790740263.458192:0:5835:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1790740263.458238:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1790740263.458240:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1790740263.460059:0:7629:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1790740263.464910:0:7629:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1790740263.465076:0:7629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1790740263.465910:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1790740263.465961:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1790740263.465998:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:1.0:1790740263.466011:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1790740263.466014:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1790740263.467188:0:7630:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:2.0:1790740263.467251:0:7630:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1790740263.467397:0:7630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1790740263.467964:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1790740263.468010:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1790740263.468067:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1790740263.468079:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1790740263.468082:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1790740263.468559:0:7631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1790740263.469078:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1790740263.469118:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1790740263.469180:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1790740263.469193:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1790740263.469195:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1790740263.470308:0:7632:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:2.0:1790740263.470488:0:7632:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:2.0:1790740263.470515:0:7632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1790740263.470943:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1790740263.470989:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1790740263.471047:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:1.0:1790740263.471063:0:5835:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1790740263.471065:0:5835:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1790740263.471074:0:5835:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1790740263.471092:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f0d9f977400/0xc6b31a1b598e9ae3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740263.471109:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0d9f977000/0xc6b31a1b598e9a26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e9a1f expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740263.471122:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0d9fea6800/0xc6b31a1b598e9a50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e9a49 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740263.471129:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0d9f499800/0xc6b31a1b598e9a7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e9a73 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740263.471135:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0d9f498800/0xc6b31a1b598e9a96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e9a8f expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740263.471142:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0d9f976a00/0xc6b31a1b598e9ace lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e9ac7 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740263.471148:0:5835:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f0d9f977400/0xc6b31a1b598e9ae3 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740263.471185:0:5835:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0d9f976a00/0xc6b31a1b598e9ace lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b31a1b598e9ac7 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740263.471200:0:5835:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f0d9f976a00/0xc6b31a1b598e9ace lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b31a1b598e9ac7 expref: 16 pid: 5837 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740263.471213:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d8812fb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5835:1877727158219776:0@lo:104: 00000100:00100000:1.0:1790740263.471285:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740263.471397:0:5827:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1790740263.471410:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158219776 00000100:00100000:2.0:1790740263.471416:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158219776 00010000:00010000:1.0:1790740263.471498:0:5835:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0d9f498800/0xc6b31a1b598e9a96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b31a1b598e9a8f expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740263.471506:0:5835:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f0d9f498800/0xc6b31a1b598e9a96 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b31a1b598e9a8f expref: 16 pid: 5835 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740263.471514:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d8812d880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5835:1877727158219904:0@lo:104: 00000100:00100000:1.0:1790740263.471540:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790740263.471663:0:5835:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0d9f499800/0xc6b31a1b598e9a7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b31a1b598e9a73 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740263.471671:0:5835:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f0d9f499800/0xc6b31a1b598e9a7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b31a1b598e9a73 expref: 16 pid: 5835 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740263.471679:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d8812d180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5835:1877727158220032:0@lo:104: 00000100:00100000:1.0:1790740263.471699:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740263.471725:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158219904 00000100:00100000:2.0:1790740263.471729:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158219904 00000100:00100000:2.0:1790740263.471760:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790740263.471769:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8741b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+4:5835:x1877727158219776:12345-0@lo:104: 00010000:00010000:2.0:1790740263.471780:0:5827:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7c00/0xc6b31a1b598e9ac7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598e9ace expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740263.471835:0:5827:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790740263.471840:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8741b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+4:5835:x1877727158219776:12345-0@lo:104: Request processed in 74us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740263.471846:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790740263.471876:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790740263.471882:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8812ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+3:5835:x1877727158219904:12345-0@lo:104: 00010000:00010000:2.0:1790740263.471888:0:5827:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7000/0xc6b31a1b598e9a8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598e9a96 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740263.471914:0:5827:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790740263.471923:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8812ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+3:5835:x1877727158219904:12345-0@lo:104: Request processed in 42us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740263.471929:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1790740263.471944:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790740263.471949:0:5831:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7c00/0xc6b31a1b598e9ac7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598e9ace expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740263.471956:0:5831:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9fea7c00 already unused, calling callback (ffffffffc1baec20) 10000000:00010000:2.0:1790740263.471959:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7c00/0xc6b31a1b598e9ac7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b31a1b598e9ace expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740263.471968:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7c00/0xc6b31a1b598e9ac7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b31a1b598e9ace expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790740263.471975:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7c00/0xc6b31a1b598e9ac7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b31a1b598e9ace expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790740263.471981:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790740263.472007:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7c00/0xc6b31a1b598e9ac7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9ace expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740263.472015:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790740263.472033:0:5831:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7c00/0xc6b31a1b598e9ac7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9ace expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740263.472040:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7c00/0xc6b31a1b598e9ac7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9ace expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740263.472051:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790740263.472054:0:5831:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7000/0xc6b31a1b598e9a8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598e9a96 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740263.472070:0:5831:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9fea7000 already unused, calling callback (ffffffffc1baec20) 10000000:00010000:2.0:1790740263.472073:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7000/0xc6b31a1b598e9a8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b31a1b598e9a96 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740263.472079:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7000/0xc6b31a1b598e9a8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b31a1b598e9a96 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790740263.472085:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7000/0xc6b31a1b598e9a8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b31a1b598e9a96 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790740263.472089:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790740263.472101:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7000/0xc6b31a1b598e9a8f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9a96 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740263.472105:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790740263.472110:0:5831:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7000/0xc6b31a1b598e9a8f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9a96 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740263.472115:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7000/0xc6b31a1b598e9a8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9a96 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740263.472123:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740263.472125:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740263.472126:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740263.472137:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db6dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3306:1877727158220288:0@lo:103: 00000100:00100000:2.0:1790740263.472163:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740263.472188:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790740263.472193:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db6dc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3306:1877727158220160:0@lo:103: 00000100:00100000:2.0:1790740263.472222:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740263.472254:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158220288 00000100:00100000:2.0:1790740263.472258:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158220288 00010000:00010000:2.0:1790740263.472286:0:5830:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0d9f498800/0xc6b31a1b598e9a96 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598e9a8f expref: 17 pid: 5835 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740263.472307:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158220160 00000100:00100000:2.0:1790740263.472310:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158220160 00010000:00010000:2.0:1790740263.472330:0:5830:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0d9f976a00/0xc6b31a1b598e9ace lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598e9ac7 expref: 18 pid: 5837 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740263.472342:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790740263.472347:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db6dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+18:3306:x1877727158220288:12345-0@lo:103: 00010000:00010000:2.0:1790740263.472357:0:5830:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740263.472361:0:5830:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0d9f498800/0xc6b31a1b598e9a96 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598e9a8f expref: 18 pid: 5835 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740263.472370:0:5830:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0d9f498800/0xc6b31a1b598e9a96 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b31a1b598e9a8f expref: 18 pid: 5835 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740263.472382:0:5830:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790740263.472409:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db6dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+18:3306:x1877727158220288:12345-0@lo:103: Request processed in 61us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740263.472415:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790740263.472428:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790740263.472434:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db6dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+17:3306:x1877727158220160:12345-0@lo:103: 00010000:00010000:2.0:1790740263.472441:0:5830:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740263.472445:0:5830:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0d9f976a00/0xc6b31a1b598e9ace lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598e9ac7 expref: 17 pid: 5837 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740263.472464:0:5830:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0d9f976a00/0xc6b31a1b598e9ace lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b31a1b598e9ac7 expref: 17 pid: 5837 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740263.472474:0:5830:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790740263.472496:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db6dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+17:3306:x1877727158220160:12345-0@lo:103: Request processed in 62us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740263.472502:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790740263.472540:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db6dc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3306:1877727158220160:0@lo:103: 00000100:00100000:2.0:1790740263.472549:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db6dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3306:1877727158220288:0@lo:103: 00010000:00010000:0.0:1790740263.472954:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740263.473334:0:5835:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0d9fea6800/0xc6b31a1b598e9a50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b31a1b598e9a49 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740263.473347:0:5835:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f0d9fea6800/0xc6b31a1b598e9a50 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b31a1b598e9a49 expref: 16 pid: 5835 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740263.473358:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d8812e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5835:1877727158220416:0@lo:104: 00000100:00100000:1.0:1790740263.473388:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790740263.473524:0:5835:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0d9f977000/0xc6b31a1b598e9a26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b31a1b598e9a1f expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740263.473533:0:5835:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f0d9f977000/0xc6b31a1b598e9a26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b31a1b598e9a1f expref: 16 pid: 5837 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740263.473541:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d8812f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5835:1877727158220544:0@lo:104: 00000100:00100000:1.0:1790740263.473563:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740263.473686:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158220032 00000100:00100000:2.0:1790740263.473692:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158220032 00000100:00100000:2.0:1790740263.473714:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158220416 00000100:00100000:2.0:1790740263.473717:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158220416 00000100:00100000:2.0:1790740263.473728:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790740263.473734:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8812e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+4:5835:x1877727158220032:12345-0@lo:104: 00010000:00010000:2.0:1790740263.473890:0:5827:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7800/0xc6b31a1b598e9a73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598e9a7a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740263.473946:0:5827:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790740263.473952:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8812e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+4:5835:x1877727158220032:12345-0@lo:104: Request processed in 217us (2251us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740263.473958:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790740263.473975:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790740263.473981:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8812d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+3:5835:x1877727158220416:12345-0@lo:104: 00010000:00010000:2.0:1790740263.473988:0:5827:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3000/0xc6b31a1b598e9a49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598e9a50 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740263.474036:0:5827:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790740263.474041:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8812d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+3:5835:x1877727158220416:12345-0@lo:104: Request processed in 61us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740263.474047:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:2.0:1790740263.474064:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790740263.474069:0:5832:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7800/0xc6b31a1b598e9a73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598e9a7a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740263.474077:0:5832:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9fea7800 already unused, calling callback (ffffffffc1baec20) 10000000:00010000:2.0:1790740263.474081:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7800/0xc6b31a1b598e9a73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b31a1b598e9a7a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740263.474089:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7800/0xc6b31a1b598e9a73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b31a1b598e9a7a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790740263.474096:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7800/0xc6b31a1b598e9a73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b31a1b598e9a7a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790740263.474102:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790740263.474126:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7800/0xc6b31a1b598e9a73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9a7a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740263.474132:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790740263.474149:0:5832:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7800/0xc6b31a1b598e9a73 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9a7a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740263.474156:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7800/0xc6b31a1b598e9a73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9a7a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740263.474175:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790740263.474179:0:5832:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3000/0xc6b31a1b598e9a49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598e9a50 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740263.474185:0:5832:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc21d3000 already unused, calling callback (ffffffffc1baec20) 10000000:00010000:2.0:1790740263.474188:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3000/0xc6b31a1b598e9a49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b31a1b598e9a50 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740263.474194:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3000/0xc6b31a1b598e9a49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b31a1b598e9a50 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790740263.474201:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3000/0xc6b31a1b598e9a49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b31a1b598e9a50 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790740263.474207:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790740263.474221:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3000/0xc6b31a1b598e9a49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9a50 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740263.474227:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790740263.474232:0:5832:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3000/0xc6b31a1b598e9a49 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9a50 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740263.474238:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3000/0xc6b31a1b598e9a49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9a50 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740263.474247:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740263.474249:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740263.474251:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740263.474305:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740263.474397:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d850c80c0 going to sleep for 11 seconds 00010000:00010000:1.0:1790740263.474418:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0d9f976a00/0xc6b31a1b598e9ace lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b31a1b598e9ac7 expref: 16 pid: 5837 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740263.474432:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d8812fb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5835:1877727158219776:0@lo:104: 00010000:00010000:1.0:1790740263.474456:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0d9f498800/0xc6b31a1b598e9a96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b31a1b598e9a8f expref: 15 pid: 5835 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740263.474465:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d8812d880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5835:1877727158219904:0@lo:104: 00000100:00100000:1.0:1790740263.474474:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d8812d180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5835:1877727158220032:0@lo:104: 00000100:00100000:1.0:1790740263.474480:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d8812e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5835:1877727158220416:0@lo:104: 00000100:00100000:2.0:1790740263.474522:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158220544 00000100:00100000:2.0:1790740263.474531:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158220544 00000100:00100000:2.0:1790740263.474552:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790740263.474558:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8812ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+3:5835:x1877727158220544:12345-0@lo:104: 00010000:00010000:2.0:1790740263.474566:0:5827:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3200/0xc6b31a1b598e9a1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598e9a26 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740263.474645:0:5827:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790740263.474650:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8812ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+3:5835:x1877727158220544:12345-0@lo:104: Request processed in 92us (1086us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740263.474657:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790740263.474724:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d8812f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5835:1877727158220544:0@lo:104: 00010000:00010000:1.0:1790740263.474757:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f0d9f977400/0xc6b31a1b598e9ae3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740263.474925:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790740263.474930:0:5832:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3200/0xc6b31a1b598e9a1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598e9a26 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740263.474936:0:5832:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc21d3200 already unused, calling callback (ffffffffc1baec20) 10000000:00010000:0.0:1790740263.474939:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3200/0xc6b31a1b598e9a1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b31a1b598e9a26 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740263.474946:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3200/0xc6b31a1b598e9a1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b31a1b598e9a26 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790740263.474952:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3200/0xc6b31a1b598e9a1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b31a1b598e9a26 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740263.474957:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790740263.474990:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3200/0xc6b31a1b598e9a1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9a26 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740263.474997:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790740263.475019:0:5832:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3200/0xc6b31a1b598e9a1f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9a26 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740263.475025:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3200/0xc6b31a1b598e9a1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9a26 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740263.475039:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740263.475041:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740263.475042:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740263.475084:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc0963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3305:1877727158220928:0@lo:103: 00000100:00100000:1.0:1790740263.475118:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740263.476964:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158220928 00000100:00100000:0.0:1790740263.476978:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158220928 00010000:00010000:0.0:1790740263.477018:0:5830:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0d9f977000/0xc6b31a1b598e9a26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598e9a1f expref: 15 pid: 5837 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740263.477060:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790740263.477069:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8812f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+15:3305:x1877727158220928:12345-0@lo:103: 00010000:00010000:0.0:1790740263.477081:0:5830:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740263.477086:0:5830:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0d9f977000/0xc6b31a1b598e9a26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598e9a1f expref: 15 pid: 5837 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740263.477098:0:5830:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0d9f977000/0xc6b31a1b598e9a26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b31a1b598e9a1f expref: 15 pid: 5837 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740263.477114:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0d9f977000/0xc6b31a1b598e9a26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b31a1b598e9a1f expref: 15 pid: 5837 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740263.477133:0:5830:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740263.477204:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8812f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+14:3305:x1877727158220928:12345-0@lo:103: Request processed in 135us (2084us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740263.477211:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790740263.477335:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc0963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3305:1877727158220928:0@lo:103: 00000100:00100000:3.0:1790740263.478506:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db6dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3303:1877727158220672:0@lo:103: 00000100:00100000:3.0:1790740263.478559:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740263.478624:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790740263.478631:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db6dc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3303:1877727158220800:0@lo:103: 00000100:00100000:3.0:1790740263.478651:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740263.478734:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158220672 00000100:00100000:0.0:1790740263.478751:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158220672 00010000:00010000:0.0:1790740263.478780:0:5830:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0d9f499800/0xc6b31a1b598e9a7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598e9a73 expref: 14 pid: 5835 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740263.478814:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158220800 00000100:00100000:0.0:1790740263.478818:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158220800 00010000:00010000:0.0:1790740263.478830:0:5830:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0d9fea6800/0xc6b31a1b598e9a50 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598e9a49 expref: 15 pid: 5835 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740263.478843:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790740263.478849:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db5a6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+15:3303:x1877727158220672:12345-0@lo:103: 00010000:00010000:0.0:1790740263.478859:0:5830:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740263.478863:0:5830:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0d9f499800/0xc6b31a1b598e9a7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598e9a73 expref: 15 pid: 5835 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740263.478873:0:5830:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0d9f499800/0xc6b31a1b598e9a7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b31a1b598e9a73 expref: 15 pid: 5835 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740263.478887:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0d9f499800/0xc6b31a1b598e9a7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b31a1b598e9a73 expref: 15 pid: 5835 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740263.478899:0:5830:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740263.478929:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db5a6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+14:3303:x1877727158220672:12345-0@lo:103: Request processed in 80us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740263.478935:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790740263.478951:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790740263.478957:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db5a69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+13:3303:x1877727158220800:12345-0@lo:103: 00010000:00010000:0.0:1790740263.478976:0:5830:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740263.478981:0:5830:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0d9fea6800/0xc6b31a1b598e9a50 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598e9a49 expref: 13 pid: 5835 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740263.478988:0:5830:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0d9fea6800/0xc6b31a1b598e9a50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b31a1b598e9a49 expref: 13 pid: 5835 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740263.478997:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0d9fea6800/0xc6b31a1b598e9a50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b31a1b598e9a49 expref: 13 pid: 5835 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740263.479007:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f0d9f977400/0xc6b31a1b598e9ae3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740263.479014:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0d9f977400/0xc6b31a1b598e9ae3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740263.479028:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f0d9f977400/0xc6b31a1b598e9ae3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740263.479034:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f0d9f977400/0xc6b31a1b598e9ae3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740263.479040:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f0d9f977400/0xc6b31a1b598e9ae3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740263.479047:0:5830:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f0d9f977400/0xc6b31a1b598e9ae3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740263.479053:0:5830:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f977400 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:0.0:1790740263.479057:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f0d9f977400/0xc6b31a1b598e9ae3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740263.479074:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f0d9f977400/0xc6b31a1b598e9ae3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740263.479086:0:5830:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f0d9f977400/0xc6b31a1b598e9ae3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740263.479095:0:5830:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740263.479118:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db5a69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+12:3303:x1877727158220800:12345-0@lo:103: Request processed in 161us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740263.479124:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1790740263.479331:0:5835:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f0d9f977400/0xc6b31a1b598e9ae3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740263.479339:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f0d9f977400/0xc6b31a1b598e9ae3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740263.479345:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0d9f977400/0xc6b31a1b598e9ae3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790740263.479364:0:5835:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1790740263.479493:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db6dc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3303:1877727158220800:0@lo:103: 00000100:00100000:3.0:1790740263.479502:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db6dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3303:1877727158220672:0@lo:103: 00000100:00100000:2.0:1790740263.526632:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d84876850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+11:7627:x1877727158219648:12345-0@lo:253: Request processed in 79101us (79432us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740263.526647:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790740263.526753:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db5a69880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:7627:1877727158219648:0@lo:253: 10000000:01000000:3.0:1790740263.526768:0:7627:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1790740263.526772:0:7627:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790740263.526773:0:7627:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790740263.526775:0:7627:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790740263.526776:0:7627:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1790740263.526777:0:7627:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790740263.526778:0:7627:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790740263.526779:0:7627:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790740263.526780:0:7627:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1790740263.526782:0:7627:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790740263.526783:0:7627:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1790740263.526865:0:7627:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8f0db562c800 from lustre-OST0001 10000000:01000000:3.0:1790740263.526891:0:7627:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1790740263.526893:0:7627:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1790740263.526901:0:7627:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8f0d87f419c0 local copy 10000000:01000000:3.0:1790740263.526905:0:7627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1790740263.526941:0:7627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499400/0xc6b31a1b598e9aea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740263.526953:0:7627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499400/0xc6b31a1b598e9aea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740263.526963:0:7627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499400/0xc6b31a1b598e9aea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740263.526980:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db5a69880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:7627:1877727158221056:0@lo:101: 00000100:00100000:3.0:1790740263.527015:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740263.527068:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0dbec32f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790740263.527245:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158221056 00000100:00100000:1.0:1790740263.527253:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158221056 00000100:00100000:1.0:1790740263.527303:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1790740263.527312:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+11:7627:x1877727158221056:12345-0@lo:101: 00010000:00010000:1.0:1790740263.527341:0:5836:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740263.527356:0:5836:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0d9f977400/0xc6b31a1b598e9af1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b31a1b598e9aea expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740263.527380:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0d9f977400/0xc6b31a1b598e9af1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b31a1b598e9aea expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740263.527390:0:5836:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0d9f977400/0xc6b31a1b598e9af1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e9aea expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740263.527398:0:5836:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9f977400, rc 0) 00000100:00100000:1.0:1790740263.527436:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+12:7627:x1877727158221056:12345-0@lo:101: Request processed in 126us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740263.527443:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1790740263.527550:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db5a69880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:7627:1877727158221056:0@lo:101: 00010000:00010000:3.0:1790740263.527563:0:7627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499400/0xc6b31a1b598e9aea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xc6b31a1b598e9af1 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740263.527777:0:7627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499400/0xc6b31a1b598e9aea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc6b31a1b598e9af1 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740263.527945:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db5a69880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:7627:1877727158221184:0@lo:501: 00000100:00100000:3.0:1790740263.527973:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740263.528003:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0dbec32f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790740263.528062:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158221184 00000100:00100000:2.0:1790740263.528068:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158221184 00000100:00100000:2.0:1790740263.528099:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1790740263.528107:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+12:7627:x1877727158221184:12345-0@lo:501: 00000100:00100000:2.0:1790740263.528438:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+12:7627:x1877727158221184:12345-0@lo:501: Request processed in 332us (463us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790740263.528446:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790740263.528526:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db5a69880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:7627:1877727158221184:0@lo:501: 10000000:01000000:3.0:1790740263.528539:0:7627:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.158@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1790740263.528563:0:7627:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.158@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1790740263.528569:0:7627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499400/0xc6b31a1b598e9aea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc6b31a1b598e9af1 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740263.528609:0:7627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499400/0xc6b31a1b598e9aea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc6b31a1b598e9af1 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740263.528617:0:7627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499400/0xc6b31a1b598e9aea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc6b31a1b598e9af1 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740263.528630:0:7627:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1790740263.528650:0:7627:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f0db562c800 10000000:01000000:3.0:1790740263.528654:0:7627:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1790740263.528659:0:7627:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1790740263.528661:0:7627:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790740263.528665:0:7627:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1790740263.528668:0:7627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1790740263.528685:0:7627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9f498600/0xc6b31a1b598e9af8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740263.528704:0:7627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.158@tcp lock: ffff8f0d9f498600/0xc6b31a1b598e9af8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740263.528713:0:7627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.158@tcp lock: ffff8f0d9f498600/0xc6b31a1b598e9af8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740263.528726:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db5a69880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:7627:1877727158221312:0@lo:101: 00000100:00100000:3.0:1790740263.528755:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740263.528780:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0dbec32a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790740263.528890:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158221312 00000100:00100000:1.0:1790740263.528896:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158221312 00000100:00100000:1.0:1790740263.528921:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790740263.528927:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+12:7627:x1877727158221312:12345-0@lo:101: 00010000:00010000:1.0:1790740263.528935:0:5836:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740263.528946:0:5836:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0d9f976a00/0xc6b31a1b598e9aff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b31a1b598e9af8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740263.528962:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0d9f976a00/0xc6b31a1b598e9aff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b31a1b598e9af8 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740263.528970:0:5836:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0d9f976a00/0xc6b31a1b598e9aff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e9af8 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740263.528977:0:5836:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9f976a00, rc 0) 00000100:00100000:1.0:1790740263.529013:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+13:7627:x1877727158221312:12345-0@lo:101: Request processed in 86us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740263.529020:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00010000:0.0:1790740263.529246:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790740263.529255:0:5831:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499400/0xc6b31a1b598e9aea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xc6b31a1b598e9af1 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740263.529262:0:5831:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f499400 already unused, calling callback (ffffffffc1baec20) 10000000:00010000:0.0:1790740263.529265:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499400/0xc6b31a1b598e9aea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xc6b31a1b598e9af1 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740263.529283:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499400/0xc6b31a1b598e9aea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xc6b31a1b598e9af1 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790740263.529291:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499400/0xc6b31a1b598e9aea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xc6b31a1b598e9af1 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740263.529295:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790740263.529316:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499400/0xc6b31a1b598e9aea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc6b31a1b598e9af1 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740263.529322:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790740263.529356:0:5831:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499400/0xc6b31a1b598e9aea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc6b31a1b598e9af1 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740263.529364:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499400/0xc6b31a1b598e9aea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc6b31a1b598e9af1 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740263.529377:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740263.529379:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740263.529381:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740263.529422:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790740263.529434:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc0961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3305:1877727158221440:0@lo:103: 00000100:00100000:1.0:1790740263.529464:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740263.529606:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158221440 00000100:00100000:0.0:1790740263.529612:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158221440 00000100:00100000:0.0:1790740263.529655:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790740263.529663:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8812e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+13:3305:x1877727158221440:12345-0@lo:103: 00010000:00010000:0.0:1790740263.529673:0:5830:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740263.529685:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0d9f977400/0xc6b31a1b598e9af1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc6b31a1b598e9aea expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740263.529700:0:5830:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740263.529730:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8812e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+12:3305:x1877727158221440:12345-0@lo:103: Request processed in 68us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740263.529737:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790740263.529885:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db5a69880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:7627:1877727158221312:0@lo:101: 00010000:00010000:3.0:1790740263.529900:0:7627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.158@tcp lock: ffff8f0d9f498600/0xc6b31a1b598e9af8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9aff expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740263.529909:0:7627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.158@tcp lock: ffff8f0d9f498600/0xc6b31a1b598e9af8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598e9aff expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740263.529993:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db5a69880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:7627:1877727158221568:0@lo:501: 00000100:00100000:3.0:1790740263.530021:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740263.530049:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0dbec32a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790740263.530124:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc0961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3305:1877727158221440:0@lo:103: 00000100:00100000:0.0:1790740263.530360:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158221568 00000100:00100000:0.0:1790740263.530365:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158221568 00000100:00100000:0.0:1790740263.530430:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1790740263.530438:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+12:7627:x1877727158221568:12345-0@lo:501: 00000100:00100000:0.0:1790740263.530685:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+12:7627:x1877727158221568:12345-0@lo:501: Request processed in 247us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740263.530692:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790740263.530754:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db5a69880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:7627:1877727158221568:0@lo:501: 00000100:00100000:3.0:1790740263.530782:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db5a69880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:7627:1877727158221696:0@lo:503: 00000100:00100000:3.0:1790740263.530827:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740263.531039:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0dbec32a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790740263.531106:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158221696 00000100:00100000:2.0:1790740263.531111:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158221696 00000100:00100000:1.0:1790740263.531378:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790740263.531386:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+12:7627:x1877727158221696:12345-0@lo:503: 00000100:00100000:1.0:1790740263.531542:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+12:7627:x1877727158221696:12345-0@lo:503: Request processed in 156us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740263.531549:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790740263.531641:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db5a69880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:7627:1877727158221696:0@lo:503: 00000040:00080000:3.0:1790740263.531913:0:7627:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790740263.531981:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db5a69880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:7627:1877727158221824:0@lo:502: 00000100:00100000:3.0:1790740263.532018:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740263.532368:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0dbec32a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790740263.532454:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158221824 00000100:00100000:0.0:1790740263.532466:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158221824 00000100:00100000:0.0:1790740263.532490:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1790740263.532496:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+12:7627:x1877727158221824:12345-0@lo:502: 00000100:00100000:0.0:1790740263.532673:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+12:7627:x1877727158221824:12345-0@lo:502: Request processed in 176us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740263.532681:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790740263.532759:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db5a69880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:7627:1877727158221824:0@lo:502: 00000040:00080000:3.0:1790740263.533010:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1790740263.533058:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1790740263.533093:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1790740263.533158:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1790740263.533196:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1790740263.533232:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1790740263.533261:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db5a69880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:7627:1877727158221952:0@lo:502: 00000100:00100000:3.0:1790740263.533309:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740263.533339:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0dbec32a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790740263.533448:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158221952 00000100:00100000:0.0:1790740263.533453:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158221952 00000100:00100000:0.0:1790740263.533472:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1790740263.533479:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+12:7627:x1877727158221952:12345-0@lo:502: 00000100:00100000:0.0:1790740263.533626:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+12:7627:x1877727158221952:12345-0@lo:502: Request processed in 147us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740263.533632:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790740263.533831:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db5a69880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:7627:1877727158221952:0@lo:502: 00000040:00080000:3.0:1790740263.533918:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1790740263.533928:0:7627:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1790740263.534557:0:7633:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1790740263.534566:0:7633:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1790740263.534600:0:7633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790740263.534603:0:7633:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1790740263.534608:0:7633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790740263.534622:0:7633:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8f0d87f43380) 00000020:00000080:3.0:1790740263.534643:0:7633:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1790740263.534648:0:7633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1790740263.534710:0:7633:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f0db562c800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1790740263.534718:0:7633:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1790740263.534724:0:7633:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc6b31a1b598e9b0d 00010000:00010000:3.0:1790740263.541389:0:7633:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1790740263.541858:0:7633:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1790740263.544489:0:7633:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1790740263.544903:0:7633:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1790740263.550482:0:7633:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1790740263.551548:0:7633:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1790740263.553537:0:7633:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1790740263.553549:0:7633:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790740263.553556:0:7633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740263.553558:0:7633:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1790740263.553563:0:7633:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790740263.553567:0:7633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740263.553568:0:7633:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790740263.553604:0:7633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790740263.553606:0:7633:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1790740263.553659:0:7633:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790740263.553663:0:7633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740263.553665:0:7633:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:1.0:1790740263.553668:0:7633:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1790740263.555917:0:7627:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1790740263.555955:0:7627:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.158@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1790740263.555978:0:7627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9f498600/0xc6b31a1b598e9af8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9aff expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740263.555992:0:7627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.158@tcp lock: ffff8f0d9f498600/0xc6b31a1b598e9af8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9aff expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740263.556000:0:7627:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f0db562c800 from 1 10000000:01000000:3.0:1790740263.556003:0:7627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790740263.556038:0:7627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499600/0xc6b31a1b598e9b14 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740263.556045:0:7627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499600/0xc6b31a1b598e9b14 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740263.556054:0:7627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499600/0xc6b31a1b598e9b14 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740263.556075:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db5a69880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:7627:1877727158222080:0@lo:101: 00000100:00100000:3.0:1790740263.556266:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740263.556326:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0dbec32540 going to sleep for 11 seconds 00000100:00100000:0.0:1790740263.558036:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158222080 00000100:00100000:0.0:1790740263.558049:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158222080 00000100:00100000:0.0:1790740263.558098:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1790740263.558107:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+12:7627:x1877727158222080:12345-0@lo:101: 00010000:00010000:0.0:1790740263.558122:0:5836:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740263.558367:0:5836:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0d9fea6800/0xc6b31a1b598e9b1b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b31a1b598e9b14 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740263.558397:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0d9fea6800/0xc6b31a1b598e9b1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b31a1b598e9b14 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740263.558408:0:5836:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0d9fea6800/0xc6b31a1b598e9b1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e9b14 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740263.558417:0:5836:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9fea6800, rc 0) 00000100:00100000:0.0:1790740263.558484:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+13:7627:x1877727158222080:12345-0@lo:101: Request processed in 379us (2334us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740263.558499:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1790740263.559466:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db5a69880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:7627:1877727158222080:0@lo:101: 00010000:00010000:2.0:1790740263.559490:0:7627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499600/0xc6b31a1b598e9b14 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9b1b expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740263.559502:0:7627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499600/0xc6b31a1b598e9b14 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598e9b1b expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740263.559647:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db6dc1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:7627:1877727158222208:0@lo:501: 00000100:00100000:2.0:1790740263.559689:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740263.559718:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0dc102ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1790740263.559773:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158222208 00000100:00100000:0.0:1790740263.559779:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158222208 00000100:00100000:0.0:1790740263.560333:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1790740263.560345:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+13:7627:x1877727158222208:12345-0@lo:501: 00000100:00100000:0.0:1790740263.560606:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+13:7627:x1877727158222208:12345-0@lo:501: Request processed in 264us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740263.560613:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1790740263.560790:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db6dc1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:7627:1877727158222208:0@lo:501: 00000100:00100000:2.0:1790740263.560898:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db6dc1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:7627:1877727158222336:0@lo:503: 00000100:00100000:2.0:1790740263.560940:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740263.563757:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0dc102ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1790740263.564096:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158222336 00000100:00100000:3.0:1790740263.564107:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158222336 00000100:00100000:3.0:1790740263.564305:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1790740263.564315:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+13:7627:x1877727158222336:12345-0@lo:503: 00000100:00100000:3.0:1790740263.564699:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+13:7627:x1877727158222336:12345-0@lo:503: Request processed in 385us (3758us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740263.564713:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1790740263.564787:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db6dc1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:7627:1877727158222336:0@lo:503: 00000040:00080000:3.0:1790740263.565907:0:7627:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790740263.565985:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db5a6b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:7627:1877727158222464:0@lo:502: 00000100:00100000:3.0:1790740263.566040:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740263.566066:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0dbec329c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790740263.566087:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158222464 00000100:00100000:3.0:1790740263.566094:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158222464 00000100:00100000:3.0:1790740263.566930:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1790740263.566944:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+13:7627:x1877727158222464:12345-0@lo:502: 00000100:00100000:3.0:1790740263.567317:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+13:7627:x1877727158222464:12345-0@lo:502: Request processed in 377us (1276us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740263.568830:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1790740263.568906:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db5a6b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:7627:1877727158222464:0@lo:502: 00000040:00080000:3.0:1790740263.569329:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1790740263.569370:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1790740263.569400:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db5a6b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:7627:1877727158222592:0@lo:502: 00000100:00100000:3.0:1790740263.569496:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740263.569566:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0dbec329c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790740263.569733:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158222592 00000100:00100000:2.0:1790740263.569741:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158222592 00000100:00100000:2.0:1790740263.569783:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1790740263.569804:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+13:7627:x1877727158222592:12345-0@lo:502: 00000100:00100000:2.0:1790740263.569967:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+13:7627:x1877727158222592:12345-0@lo:502: Request processed in 171us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740263.569974:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790740263.570068:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db5a6b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:7627:1877727158222592:0@lo:502: 00000040:00080000:3.0:1790740263.570251:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1790740263.570263:0:7627:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1790740263.570774:0:7637:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790740263.570784:0:7637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790740263.570786:0:7637:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1790740263.570792:0:7637:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f0db562c800 00000020:00000080:3.0:1790740263.570800:0:7637:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790740263.570822:0:7637:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790740263.570826:0:7637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790740263.570827:0:7637:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1790740263.570830:0:7637:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1790740263.570950:0:7627:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1790740263.570968:0:7627:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790740263.571015:0:7627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499600/0xc6b31a1b598e9b14 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9b1b expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740263.571026:0:7627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499600/0xc6b31a1b598e9b14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9b1b expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740263.571068:0:7627:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1790740263.571071:0:7627:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f0db562c800 10000000:01000000:0.0:1790740263.571075:0:7627:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f0db562c800 10000000:01000000:0.0:1790740263.571080:0:7627:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790740263.571085:0:7627:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f0db562c800 from 1 10000000:01000000:0.0:1790740263.571092:0:7627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790740263.571121:0:7627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7800/0xc6b31a1b598e9b22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740263.571173:0:7627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7800/0xc6b31a1b598e9b22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740263.571184:0:7627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7800/0xc6b31a1b598e9b22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740263.571210:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc0960700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:7627:1877727158222720:0@lo:101: 00000100:00100000:0.0:1790740263.571251:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740263.571293:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0c810923c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790740263.571353:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158222720 00000100:00100000:3.0:1790740263.571359:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158222720 00000100:00100000:3.0:1790740263.571397:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1790740263.571406:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+13:7627:x1877727158222720:12345-0@lo:101: 00010000:00010000:3.0:1790740263.571417:0:5836:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740263.571429:0:5836:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0d9f498200/0xc6b31a1b598e9b29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b31a1b598e9b22 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740263.571449:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0d9f498200/0xc6b31a1b598e9b29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b31a1b598e9b22 expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740263.571457:0:5836:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0d9f498200/0xc6b31a1b598e9b29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e9b22 expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740263.571463:0:5836:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9f498200, rc 0) 00000100:00100000:3.0:1790740263.571494:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+14:7627:x1877727158222720:12345-0@lo:101: Request processed in 90us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740263.571501:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1790740263.571523:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc0960700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:7627:1877727158222720:0@lo:101: 00010000:00010000:0.0:1790740263.571537:0:7627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7800/0xc6b31a1b598e9b22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9b29 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740263.571545:0:7627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7800/0xc6b31a1b598e9b22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598e9b29 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740263.571648:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc0960700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:7627:1877727158222848:0@lo:501: 00000100:00100000:0.0:1790740263.571679:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740263.571705:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0c810923c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790740263.571711:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158222848 00000100:00100000:2.0:1790740263.571715:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158222848 00000100:00100000:2.0:1790740263.571769:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1790740263.571777:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+14:7627:x1877727158222848:12345-0@lo:501: 00000100:00100000:2.0:1790740263.571963:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+14:7627:x1877727158222848:12345-0@lo:501: Request processed in 186us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740263.571970:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1790740263.572050:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc0960700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:7627:1877727158222848:0@lo:501: 00000100:00100000:0.0:1790740263.572077:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc0960700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:7627:1877727158222976:0@lo:503: 00000100:00100000:0.0:1790740263.572113:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740263.572136:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0c810923c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790740263.572208:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158222976 00000100:00100000:3.0:1790740263.572213:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158222976 00000100:00100000:3.0:1790740263.572241:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1790740263.572247:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+14:7627:x1877727158222976:12345-0@lo:503: 00000100:00100000:3.0:1790740263.572402:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+14:7627:x1877727158222976:12345-0@lo:503: Request processed in 155us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740263.572409:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1790740263.572488:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc0960700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:7627:1877727158222976:0@lo:503: 00000040:00080000:0.0:1790740263.572989:0:7627:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790740263.573044:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc0960700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:7627:1877727158223104:0@lo:502: 00000100:00100000:0.0:1790740263.573081:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740263.573112:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0c810923c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790740263.573320:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158223104 00000100:00100000:2.0:1790740263.573326:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158223104 00000100:00100000:2.0:1790740263.573363:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1790740263.573371:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+14:7627:x1877727158223104:12345-0@lo:502: 00000100:00100000:2.0:1790740263.573563:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+14:7627:x1877727158223104:12345-0@lo:502: Request processed in 192us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740263.573569:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1790740263.573697:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc0960700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:7627:1877727158223104:0@lo:502: 00000040:00080000:0.0:1790740263.573914:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1790740263.573982:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1790740263.574019:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1790740263.574076:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1790740263.574110:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1790740263.574457:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1790740263.574494:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1790740263.574549:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1790740263.574640:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1790740263.574678:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1790740263.574719:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1790740263.574767:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1790740263.574798:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1790740263.574833:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1790740263.574879:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1790740263.574908:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1790740263.574940:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1790740263.574981:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1790740263.575001:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1790740263.575017:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1790740263.575053:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1790740263.575327:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1790740263.575369:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1790740263.575436:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1790740263.575474:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1790740263.575508:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1790740263.575553:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1790740263.575631:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:0.0:1790740263.575665:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1790740263.575715:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1790740263.575751:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1790740263.575786:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1790740263.575835:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1790740263.575881:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1790740263.575942:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1790740263.575988:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1790740263.576029:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1790740263.576075:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc0960700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:7627:1877727158223232:0@lo:502: 00000100:00100000:0.0:1790740263.576146:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740263.576183:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0c810923c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790740263.576552:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158223232 00000100:00100000:0.0:1790740263.576560:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158223232 00000100:00100000:0.0:1790740263.576631:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1790740263.576641:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83fec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+14:7627:x1877727158223232:12345-0@lo:502: 00000100:00100000:0.0:1790740263.577088:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83fec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+14:7627:x1877727158223232:12345-0@lo:502: Request processed in 447us (940us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740263.577096:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1790740263.577366:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc0960700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:7627:1877727158223232:0@lo:502: 00000040:00080000:2.0:1790740263.577459:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:2.0:1790740263.577473:0:7627:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1790740263.578258:0:7638:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1790740263.578286:0:7638:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8f0db6d799c0) 00000020:00000080:0.0:1790740263.578306:0:7638:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1790740263.578374:0:7638:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f0db562c800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1790740263.578378:0:7638:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f0db562c800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1790740263.578381:0:7638:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f0db562c800 3 00010000:00080000:0.0:1790740263.578407:0:7638:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f0db5616000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.158@tcp at head 00010000:00010000:0.0:1790740263.580748:0:7638:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:0.0:1790740263.581051:0:7638:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1790740263.581087:0:7638:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1790740263.581098:0:7638:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xc6b31a1b598e9b37 00000100:00080000:0.0:1790740263.581107:0:7638:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790740263.581117:0:7638:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8f0db5616000 using connection 192.168.203.158@tcp/0@lo 00000100:00100000:0.0:1790740263.581155:0:7638:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f0dc0962a00 x1877727158223360/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790740263.581182:0:7638:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1790740263.581460:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc0962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1877727158223360:0@lo:38: 00000100:00100000:1.0:1790740263.581524:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740263.581721:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db5a69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1877727158223616:0@lo:400: 00000100:00100000:3.0:1790740263.581750:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740263.581770:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790740263.581776:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db5a6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877727158223488:0@lo:400: 00000100:00100000:3.0:1790740263.581810:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740263.581834:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db5a68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158223744:0@lo:400: 00000100:00100000:3.0:1790740263.581860:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740263.581902:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158223360 00000100:00100000:3.0:1790740263.581909:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158223360 00000100:00100000:3.0:1790740263.581929:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158223616 00000100:00100000:3.0:1790740263.581932:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158223616 00000100:00100000:3.0:1790740263.581962:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158223488 00000100:00100000:3.0:1790740263.581965:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158223488 00000100:00100000:3.0:1790740263.581980:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790740263.581988:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db5a68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877727158223616:12345-0@lo:400: 00000100:00100000:3.0:1790740263.582036:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db5a68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877727158223616:12345-0@lo:400: Request processed in 49us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740263.582043:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790740263.582061:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790740263.582068:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db5a6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877727158223488:12345-0@lo:400: 00000100:00100000:3.0:1790740263.582095:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db5a6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877727158223488:12345-0@lo:400: Request processed in 29us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740263.582101:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790740263.582113:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790740263.582117:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8812d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3302:x1877727158223360:12345-0@lo:38: 00010000:00080000:3.0:1790740263.582136:0:5844:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 179 last 0 00000020:00000080:3.0:1790740263.582165:0:5844:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xc6b31a1b598e9b3e 00000004:00100000:3.0:1790740263.582186:0:5844:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1790740263.582217:0:5844:0:(import.c:65:import_set_state_nolock()) ffff8f0dc1a86000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790740263.582257:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8812d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877727158223360:12345-0@lo:38: Request processed in 138us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740263.582263:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790740263.582299:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158223744 00000100:00100000:3.0:1790740263.582303:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158223744 00000100:00100000:3.0:1790740263.582328:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790740263.582335:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db5a69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158223744:12345-0@lo:400: 00000100:00100000:3.0:1790740263.582367:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db5a69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158223744:12345-0@lo:400: Request processed in 33us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740263.582373:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1790740263.582390:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790740263.582394:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1790740263.582423:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f0dc0962a00 x1877727158223360/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790740273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740263.582433:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790740263.582441:0:3302:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1790740263.582447:0:3302:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1790740263.582451:0:3302:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1790740263.582453:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8f0db5616000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1790740263.582458:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc0962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1877727158223360:0@lo:38: 00010000:00080000:3.0:1790740263.582489:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f0db5a68000 x1877727158223744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740263.582498:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db5a68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158223744:0@lo:400: 00010000:00080000:3.0:1790740263.582518:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f0db5a6b800 x1877727158223488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740263.582533:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db5a6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877727158223488:0@lo:400: 00010000:00080000:3.0:1790740263.582546:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f0db5a69180 x1877727158223616/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740263.582554:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db5a69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1877727158223616:0@lo:400: 00000100:00100000:1.0:1790740263.582998:0:7639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d8812d880 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7639:1877727158223872:0@lo:901: 00000100:00100000:1.0:1790740263.583040:0:7639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740263.583069:0:7639:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d850c86c0 going to sleep for 11 seconds 00000040:00080000:0.0:1790740263.583206:0:7638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:3.0:1790740263.583351:0:5853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158223872 00000100:00100000:3.0:1790740263.583357:0:5853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158223872 00000100:00100000:3.0:1790740263.583402:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790740263.583411:0:5853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8812fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7639:x1877727158223872:12345-0@lo:901: 00000100:00100000:3.0:1790740263.583770:0:5853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8812fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7639:x1877727158223872:12345-0@lo:901: Request processed in 359us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740263.583777:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1790740263.583941:0:7639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f0d8812d880 x1877727158223872/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1790740279 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740263.583953:0:7639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d8812d880 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7639:1877727158223872:0@lo:901: 00000100:00080000:0.0:1790740263.584149:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000000:0.0:1790740263.584635:0:7627:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1790740263.584659:0:7627:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790740263.584675:0:7627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7800/0xc6b31a1b598e9b22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9b29 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740263.584686:0:7627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7800/0xc6b31a1b598e9b22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9b29 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1790740263.584728:0:7627:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1790740263.584730:0:7627:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790740263.584731:0:7627:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790740263.584733:0:7627:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790740263.584734:0:7627:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790740263.584735:0:7627:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790740263.584736:0:7627:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790740263.584738:0:7627:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790740263.584739:0:7627:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790740263.584740:0:7627:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790740263.584741:0:7627:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790740263.584745:0:7627:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1790740263.584747:0:7627:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790740263.584748:0:7627:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790740263.584749:0:7627:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790740263.584751:0:7627:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790740263.584752:0:7627:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790740263.584753:0:7627:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790740263.584754:0:7627:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790740263.584755:0:7627:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790740263.584756:0:7627:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790740263.584757:0:7627:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790740263.584758:0:7627:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790740263.584777:0:7627:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1790740263.584789:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc0960e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:7627:1877727158224000:0@lo:253: 00000100:00100000:0.0:1790740263.584849:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740263.584886:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0c81092c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790740263.585137:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158224000 00000100:00100000:1.0:1790740263.585145:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158224000 00000100:00100000:1.0:1790740263.585184:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1790740263.585191:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83fed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+14:7627:x1877727158224000:12345-0@lo:253: 20000000:01000000:1.0:1790740263.585215:0:5835:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1790740263.585227:0:5835:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1790740263.609071:0:5835:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1790740263.609085:0:5835:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1790740263.609094:0:5858:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1790740263.609099:0:5858:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1790740263.609121:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f0dc21d3000/0xc6b31a1b598e9b45 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740263.609259:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0dc21d3400/0xc6b31a1b598e9a88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e9a81 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740263.609278:0:5858:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f0dc21d3000/0xc6b31a1b598e9b45 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740263.609318:0:5858:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0dc21d3400/0xc6b31a1b598e9a88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b31a1b598e9a81 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740263.609333:0:5858:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f0dc21d3400/0xc6b31a1b598e9a88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b31a1b598e9a81 expref: 14 pid: 5837 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740263.609348:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db6dc1500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1877727158224128:0@lo:104: 00000100:00100000:2.0:1790740263.609409:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740263.609637:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0dc102ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790740263.609676:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158224128 00000100:00100000:3.0:1790740263.609685:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158224128 00000100:00100000:3.0:1790740263.609729:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790740263.609739:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db6dc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+3:5858:x1877727158224128:12345-0@lo:104: 00010000:00010000:3.0:1790740263.609751:0:5827:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea6200/0xc6b31a1b598e9a81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598e9a88 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740263.609803:0:5827:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790740263.609809:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db6dc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+3:5858:x1877727158224128:12345-0@lo:104: Request processed in 72us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740263.609816:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1790740263.609843:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740263.609849:0:5832:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea6200/0xc6b31a1b598e9a81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598e9a88 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740263.609873:0:5832:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9fea6200 already unused, calling callback (ffffffffc1baec20) 10000000:00010000:3.0:1790740263.609877:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea6200/0xc6b31a1b598e9a81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b31a1b598e9a88 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740263.609879:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db6dc1500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1877727158224128:0@lo:104: 00010000:00010000:3.0:1790740263.609885:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea6200/0xc6b31a1b598e9a81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b31a1b598e9a88 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790740263.609892:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea6200/0xc6b31a1b598e9a81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b31a1b598e9a88 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740263.609896:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790740263.609896:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f0dc21d3000/0xc6b31a1b598e9b45 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740263.609923:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea6200/0xc6b31a1b598e9a81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9a88 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740263.609929:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790740263.609951:0:5832:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea6200/0xc6b31a1b598e9a81 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9a88 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740263.609965:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea6200/0xc6b31a1b598e9a81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9a88 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740263.609979:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740263.609981:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740263.609983:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740263.609996:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790740263.610007:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db5a69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3305:1877727158224256:0@lo:103: 00000100:00100000:3.0:1790740263.610050:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740263.611810:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158224256 00000100:00100000:0.0:1790740263.611823:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158224256 00010000:00010000:0.0:1790740263.611856:0:5828:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0dc21d3400/0xc6b31a1b598e9a88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598e9a81 expref: 15 pid: 5837 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740263.611886:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790740263.612052:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d87401850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+15:3305:x1877727158224256:12345-0@lo:103: 00010000:00010000:0.0:1790740263.612068:0:5828:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740263.612074:0:5828:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0dc21d3400/0xc6b31a1b598e9a88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598e9a81 expref: 15 pid: 5837 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740263.612085:0:5828:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0dc21d3400/0xc6b31a1b598e9a88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b31a1b598e9a81 expref: 15 pid: 5837 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740263.612102:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0dc21d3400/0xc6b31a1b598e9a88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b31a1b598e9a81 expref: 15 pid: 5837 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740263.612119:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f0dc21d3000/0xc6b31a1b598e9b45 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740263.612128:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0dc21d3000/0xc6b31a1b598e9b45 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790740263.612144:0:5828:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004072871s 00010000:00010000:0.0:1790740263.612149:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f0dc21d3000/0xc6b31a1b598e9b45 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740263.612305:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f0dc21d3000/0xc6b31a1b598e9b45 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740263.612314:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f0dc21d3000/0xc6b31a1b598e9b45 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740263.612341:0:5828:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f0dc21d3000/0xc6b31a1b598e9b45 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740263.612349:0:5828:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc21d3000 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:0.0:1790740263.612353:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f0dc21d3000/0xc6b31a1b598e9b45 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740263.612470:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f0dc21d3000/0xc6b31a1b598e9b45 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740263.612494:0:5828:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f0dc21d3000/0xc6b31a1b598e9b45 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740263.612506:0:5828:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740263.612569:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d87401850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+14:3305:x1877727158224256:12345-0@lo:103: Request processed in 675us (2516us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740263.613140:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1790740263.613474:0:5858:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f0dc21d3000/0xc6b31a1b598e9b45 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740263.613499:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f0dc21d3000/0xc6b31a1b598e9b45 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740263.613507:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0dc21d3000/0xc6b31a1b598e9b45 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740263.614084:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db5a69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3305:1877727158224256:0@lo:103: 00000100:00100000:2.0:1790740263.617332:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83fed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+13:7627:x1877727158224000:12345-0@lo:253: Request processed in 32131us (32472us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740263.617349:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1790740263.618158:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc0960e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:10ce3df1-3f26-4bb4-b4c3-d740981d121e:7627:1877727158224000:0@lo:253: 10000000:01000000:0.0:1790740263.618175:0:7627:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1790740263.618178:0:7627:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790740263.618180:0:7627:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790740263.618182:0:7627:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790740263.618183:0:7627:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790740263.618184:0:7627:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790740263.618185:0:7627:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790740263.618186:0:7627:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790740263.618188:0:7627:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790740263.618189:0:7627:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790740263.618191:0:7627:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790740263.618206:0:7627:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1790740263.618222:0:7627:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1790740263.636095:0:7627:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1790740263.636283:0:7627:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1790740263.636493:0:7627:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1790740263.636687:0:7627:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1790740263.636975:0:7627:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1790740263.637210:0:7627:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1790740263.638385:0:7627:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1790740263.837064:0:7627:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1790740263.837071:0:7627:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1790740263.837109:0:7627:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1790740263.837169:0:7627:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.158@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1790740263.837182:0:7627:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1790740263.837655:0:7627:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1790740264.240781:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740264.242371:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790740264.242398:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db6dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158224384:0@lo:13: 00000100:00100000:2.0:1790740264.242466:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740264.242613:0:6703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158224384 00000100:00100000:3.0:1790740264.242623:0:6703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158224384 00000100:00100000:3.0:1790740264.242671:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790740264.242690:0:6703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db6dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158224384:12345-0@lo:13: 00002000:00000024:3.0:1790740264.242726:0:6703:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790740264.242784:0:6703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db6dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158224384:12345-0@lo:13: Request processed in 106us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740264.242791:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1790740264.243143:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0db6dc1500 x1877727158224384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740280 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740264.243161:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db6dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158224384:0@lo:13: 00010000:00010000:0.0:1790740265.265840:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740266.288734:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740267.314459:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740268.341607:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740268.849879:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d8812d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3304:1877727158224512:0@lo:400: 00000100:00100000:1.0:1790740268.850197:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740268.850464:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d8812c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158224896:0@lo:400: 00000100:00100000:1.0:1790740268.850563:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740268.850645:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d8812dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877727158224640:0@lo:400: 00000100:00100000:1.0:1790740268.850694:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740268.850724:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790740268.850731:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d8812df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1877727158224768:0@lo:400: 00000100:00100000:1.0:1790740268.850754:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740268.850856:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158224512 00000100:00100000:1.0:1790740268.850864:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158224512 00000100:00100000:1.0:1790740268.850902:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1790740268.851041:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83fef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+13:3304:x1877727158224512:12345-0@lo:400: 00000100:00100000:1.0:1790740268.851090:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83fef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+13:3304:x1877727158224512:12345-0@lo:400: Request processed in 53us (893us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740268.851099:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1790740268.851206:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158224896 00000100:00100000:1.0:1790740268.851211:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158224896 00000100:00100000:1.0:1790740268.851262:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790740268.851336:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8812c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158224896:12345-0@lo:400: 00000100:00100000:1.0:1790740268.851378:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8812c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158224896:12345-0@lo:400: Request processed in 45us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740268.851385:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790740268.851405:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158224640 00000100:00100000:1.0:1790740268.851409:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158224640 00000100:00100000:1.0:1790740268.851440:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158224768 00000100:00100000:1.0:1790740268.851443:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158224768 00000100:00100000:1.0:1790740268.851459:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790740268.851466:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8812f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877727158224640:12345-0@lo:400: 00000100:00100000:1.0:1790740268.851591:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8812f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877727158224640:12345-0@lo:400: Request processed in 125us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740268.851598:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790740268.851612:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790740268.851619:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8812e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877727158224768:12345-0@lo:400: 00000100:00100000:1.0:1790740268.851656:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8812e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877727158224768:12345-0@lo:400: Request processed in 38us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740268.851661:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1790740268.851709:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0d8812c700 x1877727158224896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740284 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740268.851723:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d8812c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158224896:0@lo:400: 00000100:00100000:1.0:1790740268.851758:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d8812d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3304:1877727158224512:0@lo:400: 00000100:00100000:1.0:1790740268.851780:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d8812f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1877727158225024:0@lo:400: 00000100:00100000:1.0:1790740268.851808:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1790740268.851845:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0d8812df80 x1877727158224768/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740284 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740268.851855:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d8812df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1877727158224768:0@lo:400: 00010000:00080000:1.0:1790740268.851865:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0d8812dc00 x1877727158224640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740284 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740268.851873:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d8812dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877727158224640:0@lo:400: 00000100:00100000:1.0:1790740268.851889:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158225024 00000100:00100000:1.0:1790740268.851892:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158225024 00000100:00080000:0.0:1790740268.852013:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790740268.852020:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790740268.852211:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790740268.852219:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8812c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1877727158225024:12345-0@lo:400: 00000100:00100000:1.0:1790740268.852328:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8812c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1877727158225024:12345-0@lo:400: Request processed in 49us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740268.852336:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1790740268.852365:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0d8812f800 x1877727158225024/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740284 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740268.852389:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d8812f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1877727158225024:0@lo:400: 00010000:00010000:3.0:1790740269.360761:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740269.364223:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db5a6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158225152:0@lo:13: 00000100:00100000:2.0:1790740269.364312:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740269.364389:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158225152 00000100:00100000:2.0:1790740269.364397:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158225152 00000100:00100000:2.0:1790740269.364440:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790740269.364449:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db6dc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158225152:12345-0@lo:13: 00002000:00000024:2.0:1790740269.364482:0:6704:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790740269.364525:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db6dc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158225152:12345-0@lo:13: Request processed in 77us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740269.364532:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1790740269.364614:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0db5a6b800 x1877727158225152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740285 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740269.364632:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db5a6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158225152:0@lo:13: 00000001:02000400:1.0:1790740269.492986:0:7981:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1790740270.385088:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740271.408894:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740272.432846:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1790740273.460298:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1790740273.460305:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f0d83fe1000 from 30 10000000:01000000:3.0:1790740273.460310:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790740273.460357:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499400/0xc6b31a1b598e9b4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740273.460385:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499400/0xc6b31a1b598e9b4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740273.460398:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499400/0xc6b31a1b598e9b4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740273.460421:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db5a68000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158225280:0@lo:101: 00000100:00100000:3.0:1790740273.460485:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740273.460543:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d985bae40 going to sleep for 11 seconds 00000100:00100000:0.0:1790740273.460643:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158225280 00000100:00100000:0.0:1790740273.460652:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158225280 00000100:00100000:0.0:1790740273.460697:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1790740273.460707:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83fed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+13:5841:x1877727158225280:12345-0@lo:101: 00010000:00010000:0.0:1790740273.460719:0:5835:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740273.460731:0:5835:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0d9fea7c00/0xc6b31a1b598e9b53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b31a1b598e9b4c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740273.460756:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0d9fea7c00/0xc6b31a1b598e9b53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b31a1b598e9b4c expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740273.460769:0:5835:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0d9fea7c00/0xc6b31a1b598e9b53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e9b4c expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740273.460777:0:5835:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9fea7c00, rc 0) 00000100:00100000:0.0:1790740273.460819:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83fed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+14:5841:x1877727158225280:12345-0@lo:101: Request processed in 114us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740273.460827:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1790740273.461314:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db5a68000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158225280:0@lo:101: 00010000:00010000:3.0:1790740273.461329:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499400/0xc6b31a1b598e9b4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9b53 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740273.461339:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499400/0xc6b31a1b598e9b4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598e9b53 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740273.461395:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db5a68000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158225408:0@lo:501: 00000100:00100000:3.0:1790740273.461424:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740273.461444:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d985bae40 going to sleep for 11 seconds 00000100:00100000:0.0:1790740273.463064:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158225408 00000100:00100000:0.0:1790740273.463076:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158225408 00000100:00100000:0.0:1790740273.463130:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1790740273.463139:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83fee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+14:5841:x1877727158225408:12345-0@lo:501: 00000100:00100000:0.0:1790740273.463526:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83fee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+14:5841:x1877727158225408:12345-0@lo:501: Request processed in 386us (2099us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740273.463544:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1790740273.463624:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db5a68000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158225408:0@lo:501: 00000100:00100000:0.0:1790740273.463670:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc0960e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158225536:0@lo:503: 00000100:00100000:0.0:1790740273.463709:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740273.463734:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d87f209c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790740273.463745:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158225536 00000100:00100000:0.0:1790740273.463748:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158225536 00000100:00100000:0.0:1790740273.463767:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1790740273.463772:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83fee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+14:5841:x1877727158225536:12345-0@lo:503: 00000100:00100000:0.0:1790740273.464034:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83fee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+14:5841:x1877727158225536:12345-0@lo:503: Request processed in 261us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740273.464041:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1790740273.464076:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc0960e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158225536:0@lo:503: 00000100:00100000:0.0:1790740273.464277:0:8145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc0960e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:8145:1877727158225664:0@lo:502: 00000100:00100000:0.0:1790740273.464309:0:8145:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740273.464327:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158225664 00000100:00100000:0.0:1790740273.464331:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158225664 00000100:00100000:0.0:1790740273.464353:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1790740273.464358:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83fef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+14:8145:x1877727158225664:12345-0@lo:502: 00000100:00100000:0.0:1790740273.464542:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83fef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+14:8145:x1877727158225664:12345-0@lo:502: Request processed in 183us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740273.464549:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1790740273.465243:0:8145:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d87f20e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790740273.465264:0:8145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc0960e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:8145:1877727158225664:0@lo:502: 00000100:00100000:0.0:1790740273.465316:0:8145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc0960e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:8145:1877727158225792:0@lo:502: 00000100:00100000:0.0:1790740273.465348:0:8145:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740273.465373:0:8145:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d87f20e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790740273.465491:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158225792 00000100:00100000:2.0:1790740273.465501:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158225792 00000100:00100000:2.0:1790740273.465533:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1790740273.465539:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83fefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+14:8145:x1877727158225792:12345-0@lo:502: 00000100:00100000:2.0:1790740273.465725:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83fefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+14:8145:x1877727158225792:12345-0@lo:502: Request processed in 185us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740273.465732:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1790740273.465882:0:8145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc0960e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:8145:1877727158225792:0@lo:502: 00000040:00080000:0.0:1790740273.465900:0:8145:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1790740273.466074:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1790740273.466094:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790740273.466103:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499400/0xc6b31a1b598e9b4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9b53 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740273.466114:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499400/0xc6b31a1b598e9b4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9b53 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790740273.466123:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1790740273.466126:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1790740273.466128:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1790740273.466151:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d2c00/0xc6b31a1b598e9b5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740273.466159:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d2c00/0xc6b31a1b598e9b5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740273.466168:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d2c00/0xc6b31a1b598e9b5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740273.466180:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db6dc2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158225920:0@lo:101: 00000100:00100000:2.0:1790740273.466217:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740273.466242:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d875846c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790740273.466277:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158225920 00000100:00100000:1.0:1790740273.466282:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158225920 00000100:00100000:1.0:1790740273.466310:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1790740273.466317:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83feec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+14:5841:x1877727158225920:12345-0@lo:101: 00010000:00010000:1.0:1790740273.466324:0:5836:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740273.466335:0:5836:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0d9f976c00/0xc6b31a1b598e9b61 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b31a1b598e9b5a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740273.466354:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0d9f976c00/0xc6b31a1b598e9b61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b31a1b598e9b5a expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740273.466365:0:5836:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0d9f976c00/0xc6b31a1b598e9b61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e9b5a expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740273.466373:0:5836:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9f976c00, rc 0) 00000100:00100000:1.0:1790740273.466400:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83feec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+15:5841:x1877727158225920:12345-0@lo:101: Request processed in 84us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740273.466405:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1790740273.466430:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db6dc2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158225920:0@lo:101: 00010000:00010000:1.0:1790740273.466440:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d2c00/0xc6b31a1b598e9b5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9b61 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740273.466448:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d2c00/0xc6b31a1b598e9b5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598e9b61 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740273.466494:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d8812f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158226048:0@lo:501: 00000100:00100000:1.0:1790740273.466514:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740273.466525:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0c865cd000 going to sleep for 11 seconds 00000100:00100000:1.0:1790740273.466535:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158226048 00000100:00100000:1.0:1790740273.466538:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158226048 00000100:00100000:1.0:1790740273.466554:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1790740273.466559:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83fee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+15:5841:x1877727158226048:12345-0@lo:501: 00000100:00100000:1.0:1790740273.466887:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83fee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+15:5841:x1877727158226048:12345-0@lo:501: Request processed in 327us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740273.466894:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1790740273.466918:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d8812f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158226048:0@lo:501: 00000100:00100000:1.0:1790740273.466940:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d8812f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158226176:0@lo:503: 00000100:00100000:1.0:1790740273.466969:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740273.466979:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0c865cd000 going to sleep for 11 seconds 00000100:00100000:1.0:1790740273.466989:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158226176 00000100:00100000:1.0:1790740273.466991:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158226176 00000100:00100000:1.0:1790740273.467005:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1790740273.467009:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83fecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+15:5841:x1877727158226176:12345-0@lo:503: 00000100:00100000:1.0:1790740273.469903:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83fecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+15:5841:x1877727158226176:12345-0@lo:503: Request processed in 2885us (2924us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740273.469916:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1790740273.469999:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d8812f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158226176:0@lo:503: 00010000:00010000:3.0:1790740273.470368:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740273.483039:0:8146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc0960e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:8146:1877727158226304:0@lo:502: 00000100:00100000:0.0:1790740273.483120:0:8146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740273.489311:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158226304 00000100:00100000:1.0:1790740273.489325:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158226304 00000100:00100000:1.0:1790740273.489389:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1790740273.489398:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83fec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+15:8146:x1877727158226304:12345-0@lo:502: 00000100:00100000:1.0:1790740273.489855:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83fec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+15:8146:x1877727158226304:12345-0@lo:502: Request processed in 458us (6734us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740273.489863:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1790740273.490013:0:8146:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d87f20900 going to sleep for 11 seconds 00000100:00100000:0.0:1790740273.490042:0:8146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc0960e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:8146:1877727158226304:0@lo:502: 00000020:01000000:0.0:1790740273.490075:0:8146:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790740273.490084:0:8146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740273.490086:0:8146:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790740273.490093:0:8146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790740273.490095:0:8146:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1790740273.490123:0:8146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc0960e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:8146:1877727158226432:0@lo:502: 00000100:00100000:0.0:1790740273.490163:0:8146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740273.490192:0:8146:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d87f20900 going to sleep for 11 seconds 00000100:00100000:1.0:1790740273.493370:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158226432 00000100:00100000:1.0:1790740273.493384:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158226432 00000100:00100000:1.0:1790740273.493432:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1790740273.493443:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83fef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+15:8146:x1877727158226432:12345-0@lo:502: 00000100:00100000:1.0:1790740273.495876:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83fef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+15:8146:x1877727158226432:12345-0@lo:502: Request processed in 2425us (5703us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740273.495890:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1790740273.499762:0:8146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc0960e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:8146:1877727158226432:0@lo:502: 00000020:01000000:1.0:1790740273.499809:0:8146:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790740273.499819:0:8146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740273.499822:0:8146:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:1.0:1790740273.499827:0:8146:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1790740273.499899:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1790740273.499919:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.158@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1790740273.499930:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d2c00/0xc6b31a1b598e9b5a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9b61 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740273.499941:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d2c00/0xc6b31a1b598e9b5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9b61 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790740273.499951:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1790740273.499953:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f0d85311800 from 30 10000000:01000000:1.0:1790740273.499956:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790740273.500003:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977c00/0xc6b31a1b598e9b68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740273.500013:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977c00/0xc6b31a1b598e9b68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740273.500023:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977c00/0xc6b31a1b598e9b68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740273.500042:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d8812f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158226560:0@lo:101: 00000100:00100000:1.0:1790740273.500102:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740273.500134:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0c865cd840 going to sleep for 11 seconds 00000100:00100000:1.0:1790740273.500153:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158226560 00000100:00100000:1.0:1790740273.500160:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158226560 00000100:00100000:1.0:1790740273.500195:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1790740273.500215:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83fedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+15:5841:x1877727158226560:12345-0@lo:101: 00010000:00010000:1.0:1790740273.500228:0:5837:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740273.500241:0:5837:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0d9f977e00/0xc6b31a1b598e9b6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b31a1b598e9b68 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740273.500263:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0d9f977e00/0xc6b31a1b598e9b6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b31a1b598e9b68 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740273.500273:0:5837:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0d9f977e00/0xc6b31a1b598e9b6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e9b68 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740273.500282:0:5837:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9f977e00, rc 0) 00000100:00100000:1.0:1790740273.500316:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83fedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+16:5841:x1877727158226560:12345-0@lo:101: Request processed in 103us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740273.500323:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1790740273.500368:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d8812f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158226560:0@lo:101: 00010000:00010000:1.0:1790740273.500381:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977c00/0xc6b31a1b598e9b68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9b6f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740273.500389:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977c00/0xc6b31a1b598e9b68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598e9b6f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740273.500430:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d8812f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158226688:0@lo:501: 00000100:00100000:1.0:1790740273.500453:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740273.500467:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0c865cd840 going to sleep for 11 seconds 00000100:00100000:1.0:1790740273.500480:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158226688 00000100:00100000:1.0:1790740273.500483:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158226688 00000100:00100000:1.0:1790740273.500506:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1790740273.500513:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83fed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+16:5841:x1877727158226688:12345-0@lo:501: 00000100:00100000:1.0:1790740273.501439:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83fed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+16:5841:x1877727158226688:12345-0@lo:501: Request processed in 922us (980us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740273.501449:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1790740273.501491:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d8812f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158226688:0@lo:501: 00000100:00100000:1.0:1790740273.501524:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d8812f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158226816:0@lo:503: 00000100:00100000:1.0:1790740273.501566:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740273.502165:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0c865cd840 going to sleep for 11 seconds 00000100:00100000:1.0:1790740273.502189:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158226816 00000100:00100000:1.0:1790740273.502206:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158226816 00000100:00100000:1.0:1790740273.502252:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1790740273.502262:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83fec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+16:5841:x1877727158226816:12345-0@lo:503: 00000100:00100000:1.0:1790740273.502424:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83fec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+16:5841:x1877727158226816:12345-0@lo:503: Request processed in 163us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740273.502442:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1790740273.504150:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d8812f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158226816:0@lo:503: 00000100:00100000:2.0:1790740273.505515:0:8149:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db6dc1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:8149:1877727158226944:0@lo:502: 00000100:00100000:2.0:1790740273.505696:0:8149:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740273.505731:0:8149:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d87584f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790740273.505793:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158226944 00000100:00100000:1.0:1790740273.505801:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158226944 00000100:00100000:1.0:1790740273.505850:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1790740273.505859:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+16:8149:x1877727158226944:12345-0@lo:502: 00000100:00100000:1.0:1790740273.506087:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+16:8149:x1877727158226944:12345-0@lo:502: Request processed in 228us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740273.506094:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1790740273.506147:0:8149:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db6dc1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:8149:1877727158226944:0@lo:502: 00000100:00100000:1.0:1790740273.506196:0:8149:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d8812dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:8149:1877727158227072:0@lo:502: 00000100:00100000:1.0:1790740273.506244:0:8149:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740273.506260:0:8149:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0c865cd900 going to sleep for 11 seconds 00000100:00100000:1.0:1790740273.506756:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158227072 00000100:00100000:1.0:1790740273.506761:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158227072 00000100:00100000:1.0:1790740273.507446:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1790740273.507456:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+16:8149:x1877727158227072:12345-0@lo:502: 00000100:00100000:1.0:1790740273.507691:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+16:8149:x1877727158227072:12345-0@lo:502: Request processed in 237us (1446us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740273.507699:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1790740273.507919:0:8149:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d8812dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:8149:1877727158227072:0@lo:502: 00000040:00080000:0.0:1790740273.507948:0:8149:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1790740273.508125:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1790740273.508143:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790740273.508153:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977c00/0xc6b31a1b598e9b68 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9b6f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740273.508164:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977c00/0xc6b31a1b598e9b68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9b6f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790740273.508185:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790740273.508188:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f0d85311800 from 5 10000000:01000000:1.0:1790740273.508191:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790740273.508228:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976400/0xc6b31a1b598e9b76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740273.508237:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976400/0xc6b31a1b598e9b76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740273.508247:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976400/0xc6b31a1b598e9b76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740273.508265:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d8812df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158227200:0@lo:101: 00000100:00100000:1.0:1790740273.508297:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740273.508360:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0dbeb8bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1790740273.510939:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158227200 00000100:00100000:0.0:1790740273.510953:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158227200 00000100:00100000:0.0:1790740273.511001:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1790740273.511011:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+16:5841:x1877727158227200:12345-0@lo:101: 00010000:00010000:0.0:1790740273.511030:0:5835:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740273.511049:0:5835:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0d9fea7000/0xc6b31a1b598e9b7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b31a1b598e9b76 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740273.511091:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0d9fea7000/0xc6b31a1b598e9b7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b31a1b598e9b76 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740273.511103:0:5835:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0d9fea7000/0xc6b31a1b598e9b7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e9b76 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740273.511112:0:5835:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9fea7000, rc 0) 00000100:00100000:0.0:1790740273.511177:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+17:5841:x1877727158227200:12345-0@lo:101: Request processed in 167us (2878us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740273.511184:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1790740273.511376:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d8812df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158227200:0@lo:101: 00010000:00010000:0.0:1790740273.511394:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976400/0xc6b31a1b598e9b76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9b7d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740273.511403:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976400/0xc6b31a1b598e9b76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598e9b7d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740273.511466:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc0960380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158227328:0@lo:256: 00000100:00100000:0.0:1790740273.511502:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740273.511532:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d87f20240 going to sleep for 11 seconds 00000100:00100000:0.0:1790740273.511545:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158227328 00000100:00100000:0.0:1790740273.511549:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158227328 00000100:00100000:0.0:1790740273.511589:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1790740273.512042:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+17:5841:x1877727158227328:12345-0@lo:256: 20000000:01000000:0.0:1790740273.512060:0:5836:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790740273.512079:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790740273.512082:0:5836:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1790740273.512192:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+17:5841:x1877727158227328:12345-0@lo:256: Request processed in 595us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740273.512212:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1790740273.512381:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc0960380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158227328:0@lo:256: 10000000:01000000:1.0:1790740273.512428:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790740273.512437:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976400/0xc6b31a1b598e9b76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9b7d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740273.512446:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976400/0xc6b31a1b598e9b76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9b7d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790740273.512456:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1790740273.512458:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1790740273.512461:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1790740273.512485:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976600/0xc6b31a1b598e9b84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740273.512502:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976600/0xc6b31a1b598e9b84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740273.512511:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976600/0xc6b31a1b598e9b84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740273.512526:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d8812d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158227456:0@lo:101: 00000100:00100000:1.0:1790740273.512555:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740273.513190:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0dbeb8b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790740273.513237:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158227456 00000100:00100000:0.0:1790740273.513243:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158227456 00000100:00100000:0.0:1790740273.513315:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1790740273.513323:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+17:5841:x1877727158227456:12345-0@lo:101: 00010000:00010000:0.0:1790740273.513334:0:5837:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740273.513346:0:5837:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0d9fea6200/0xc6b31a1b598e9b8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b31a1b598e9b84 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740273.513367:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0d9fea6200/0xc6b31a1b598e9b8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b31a1b598e9b84 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740273.513376:0:5837:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0d9fea6200/0xc6b31a1b598e9b8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e9b84 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740273.513384:0:5837:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9fea6200, rc 0) 00000100:00100000:0.0:1790740273.513428:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+18:5841:x1877727158227456:12345-0@lo:101: Request processed in 106us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740273.513434:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1790740273.513497:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d8812d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158227456:0@lo:101: 00010000:00010000:2.0:1790740273.513510:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976600/0xc6b31a1b598e9b84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9b8b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740273.513519:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976600/0xc6b31a1b598e9b84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598e9b8b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740273.513590:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db6dc0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158227584:0@lo:501: 00000100:00100000:2.0:1790740273.513629:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740273.513829:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d87584840 going to sleep for 11 seconds 00000100:00100000:1.0:1790740273.513916:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158227584 00000100:00100000:1.0:1790740273.513921:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158227584 00000100:00100000:1.0:1790740273.513944:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1790740273.513950:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+18:5841:x1877727158227584:12345-0@lo:501: 00000100:00100000:1.0:1790740273.514210:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+18:5841:x1877727158227584:12345-0@lo:501: Request processed in 259us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740273.514218:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1790740273.514286:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db6dc0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158227584:0@lo:501: 00000100:00100000:2.0:1790740273.514317:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db6dc0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158227712:0@lo:503: 00000100:00100000:2.0:1790740273.514356:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740273.514380:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d87584840 going to sleep for 11 seconds 00000100:00100000:1.0:1790740273.514419:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158227712 00000100:00100000:1.0:1790740273.514423:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158227712 00000100:00100000:1.0:1790740273.514442:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1790740273.514448:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+18:5841:x1877727158227712:12345-0@lo:503: 00000100:00100000:1.0:1790740273.514949:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+18:5841:x1877727158227712:12345-0@lo:503: Request processed in 500us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740273.514956:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1790740273.515027:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db6dc0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158227712:0@lo:503: 00000100:00100000:2.0:1790740273.515366:0:8150:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db6dc0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:8150:1877727158227840:0@lo:502: 00000100:00100000:2.0:1790740273.515401:0:8150:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740273.515429:0:8150:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d87584d80 going to sleep for 11 seconds 00000100:00100000:1.0:1790740273.515469:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158227840 00000100:00100000:1.0:1790740273.515474:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158227840 00000100:00100000:1.0:1790740273.515492:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1790740273.515499:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+18:8150:x1877727158227840:12345-0@lo:502: 00000100:00100000:1.0:1790740273.516001:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+18:8150:x1877727158227840:12345-0@lo:502: Request processed in 501us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740273.516009:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1790740273.516212:0:8150:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db6dc0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:8150:1877727158227840:0@lo:502: 00000020:01000000:2.0:1790740273.516238:0:8150:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790740273.516246:0:8150:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1790740273.516253:0:8150:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790740273.516262:0:8150:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1790740273.516269:0:8150:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1790740273.516273:0:8150:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.158@tcp to nid 0x20000c0a8cb9e (192.168.203.158@tcp) 00000020:01000000:2.0:1790740273.516295:0:8150:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1790740273.516299:0:8150:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790740273.516314:0:8150:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8f0db6f58000) 00000020:00000080:2.0:1790740273.516335:0:8150:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1790740273.516341:0:8150:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1790740273.516410:0:8150:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1790740273.516416:0:8150:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:2.0:1790740273.516423:0:8150:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc6b31a1b598e9b99 00010000:00080000:2.0:1790740273.516466:0:8150:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f0db5717000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.158@tcp at head 00010000:00010000:2.0:1790740273.517329:0:8150:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:2.0:1790740273.519268:0:8150:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1790740273.519282:0:8150:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1790740273.521093:0:8150:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790740273.521405:0:8150:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790740273.521466:0:8150:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1790740273.521523:0:8150:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1790740273.523005:0:8151:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790740273.523012:0:8151:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1790740273.524476:0:8150:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790740273.524490:0:8150:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1790740273.524523:0:8150:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1790740273.524542:0:8150:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc6b31a1b598e9ba0 00000100:00080000:1.0:1790740273.524553:0:8150:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790740273.524564:0:8150:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8f0db5717000 using connection 192.168.203.158@tcp/0@lo 00000100:00100000:1.0:1790740273.524962:0:8150:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f0d8812d880 x1877727158227968/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790740273.524990:0:8150:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1790740273.525042:0:8150:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790740273.525046:0:8150:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740273.525049:0:8150:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1790740273.525052:0:8150:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790740273.525055:0:8150:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740273.525057:0:8150:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790740273.525059:0:8150:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790740273.525061:0:8150:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1790740273.525089:0:8150:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d8812df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:8150:1877727158228096:0@lo:502: 00000100:00100000:1.0:1790740273.525166:0:8150:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740273.525210:0:8150:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d98d2f240 going to sleep for 11 seconds 00000100:00100000:1.0:1790740273.525235:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158228096 00000100:00100000:1.0:1790740273.525242:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158228096 00000100:00100000:1.0:1790740273.525278:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1790740273.525287:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+18:8150:x1877727158228096:12345-0@lo:502: 00000100:00100000:1.0:1790740273.525502:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+18:8150:x1877727158228096:12345-0@lo:502: Request processed in 215us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740273.525515:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1790740273.525567:0:8150:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d8812df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:8150:1877727158228096:0@lo:502: 00000100:00100000:2.0:1790740273.525722:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d8812d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1877727158227968:0@lo:8: 00000100:00100000:2.0:1790740273.525767:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1790740273.525921:0:8150:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790740273.525927:0:8150:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740273.525929:0:8150:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:1.0:1790740273.525932:0:8150:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1790740273.526081:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1790740273.526103:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.158@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1790740273.526112:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976600/0xc6b31a1b598e9b84 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9b8b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740273.526124:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976600/0xc6b31a1b598e9b84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9b8b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790740273.526143:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1790740273.526145:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8f0d87f419c0 from 1 10000000:01000000:2.0:1790740273.526148:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1790740273.526172:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3e00/0xc6b31a1b598e9ba7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740273.526180:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3e00/0xc6b31a1b598e9ba7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740273.526189:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3e00/0xc6b31a1b598e9ba7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740273.526213:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db6dc2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158228224:0@lo:101: 00000100:00100000:2.0:1790740273.526240:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740273.526260:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d875843c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790740273.526554:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158228224 00000100:00100000:1.0:1790740273.526560:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158228224 00000100:00100000:1.0:1790740273.526686:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1790740273.526694:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+18:5841:x1877727158228224:12345-0@lo:101: 00010000:00010000:1.0:1790740273.526704:0:5835:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740273.526717:0:5835:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0d9f977600/0xc6b31a1b598e9bae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b31a1b598e9ba7 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740273.526740:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0d9f977600/0xc6b31a1b598e9bae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b31a1b598e9ba7 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740273.526751:0:5835:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0d9f977600/0xc6b31a1b598e9bae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e9ba7 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740273.526758:0:5835:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9f977600, rc 0) 00000100:00100000:1.0:1790740273.526795:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:5841:x1877727158228224:12345-0@lo:101: Request processed in 102us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740273.526801:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1790740273.526833:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db6dc2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158228224:0@lo:101: 00010000:00010000:1.0:1790740273.526847:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3e00/0xc6b31a1b598e9ba7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9bae expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740273.526867:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3e00/0xc6b31a1b598e9ba7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598e9bae expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740273.526913:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d8812df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158228352:0@lo:501: 00000100:00100000:1.0:1790740273.526937:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740273.526950:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d8962e900 going to sleep for 11 seconds 00000100:00100000:1.0:1790740273.526960:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158228352 00000100:00100000:1.0:1790740273.526964:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158228352 00000100:00100000:1.0:1790740273.526978:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1790740273.526984:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:5841:x1877727158228352:12345-0@lo:501: 00000100:00100000:3.0:1790740273.527044:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158227968 00000100:00100000:3.0:1790740273.527051:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158227968 00000100:00100000:3.0:1790740273.527084:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790740273.527091:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db6dc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3302:x1877727158227968:12345-0@lo:8: 00010000:00080000:3.0:1790740273.527126:0:6699:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 189 last 0 00000020:00000080:3.0:1790740273.527155:0:6699:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc6b31a1b598e9bb5 00002000:00100000:3.0:1790740273.527172:0:6699:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8f0dc1a84000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b03 ocd_grant: 0 ocd_index: 1 ocd_group 0 00000100:00100000:1.0:1790740273.527183:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:5841:x1877727158228352:12345-0@lo:501: Request processed in 197us (243us total) trans 0 rc -2/-2 00002000:00080000:3.0:1790740273.527187:0:6699:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:3.0:1790740273.527195:0:6699:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1790740273.527207:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1790740273.527239:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d8812df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158228352:0@lo:501: 10000000:01000000:1.0:1790740273.527260:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.158@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1790740273.527267:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3e00/0xc6b31a1b598e9ba7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9bae expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740273.527274:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3e00/0xc6b31a1b598e9ba7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9bae expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:3.0:1790740273.527310:0:6699:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1790740273.527498:0:6699:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:0.0:1790740273.527507:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc0960700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1877727158228864:0@lo:400: 00000100:00080000:3.0:1790740273.527523:0:6699:0:(import.c:65:import_set_state_nolock()) ffff8f0dc1a86800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790740273.527545:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740273.527602:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db6dc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3302:x1877727158227968:12345-0@lo:8: Request processed in 510us (1834us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740273.527609:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1790740273.527652:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0d8812d880 x1877727158227968/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790740283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740273.527664:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00100000:0.0:1790740273.527665:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790740273.527676:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc0960380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877727158228480:0@lo:400: 00000100:00100000:0.0:1790740273.527700:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740273.527724:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc0960e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1877727158228608:0@lo:400: 00000100:00100000:0.0:1790740273.527745:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740273.527768:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790740273.527773:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc0962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158228736:0@lo:400: 00000100:00100000:0.0:1790740273.527794:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740273.527821:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158228864 00000100:00100000:0.0:1790740273.527825:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158228864 00000100:00080000:3.0:1790740273.527841:0:3302:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1790740273.527851:0:3302:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00100000:0.0:1790740273.527852:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158228480 00000100:00100000:0.0:1790740273.527857:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158228480 00000100:00080000:3.0:1790740273.527858:0:3302:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1790740273.527862:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8f0db5717000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790740273.527871:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158228608 00000100:00100000:0.0:1790740273.527875:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158228608 00000004:00080000:3.0:1790740273.527878:0:3302:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1790740273.527885:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d8812d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1877727158227968:0@lo:8: 00000100:00100000:0.0:1790740273.527893:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790740273.527901:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc0961180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877727158228864:12345-0@lo:400: 00000100:00100000:0.0:1790740273.527940:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc0961180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877727158228864:12345-0@lo:400: Request processed in 40us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740273.527946:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790740273.527958:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790740273.527965:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc0963100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877727158228480:12345-0@lo:400: 00000100:00100000:0.0:1790740273.527992:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc0963100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877727158228480:12345-0@lo:400: Request processed in 28us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740273.527999:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790740273.528010:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790740273.528015:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc0960a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1877727158228608:12345-0@lo:400: 00000100:00100000:0.0:1790740273.528043:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc0960a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1877727158228608:12345-0@lo:400: Request processed in 28us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740273.528048:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790740273.528071:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158228736 00000100:00100000:0.0:1790740273.528074:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158228736 00000100:00100000:0.0:1790740273.528098:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790740273.528104:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc0963800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158228736:12345-0@lo:400: 00000100:00100000:0.0:1790740273.528137:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc0963800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158228736:12345-0@lo:400: Request processed in 33us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740273.528144:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1790740273.528158:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790740273.528162:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1790740273.528178:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dc0960380 x1877727158228480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740273.528188:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc0960380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877727158228480:0@lo:400: 00010000:00080000:0.0:1790740273.528211:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dc0960700 x1877727158228864/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740273.528219:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc0960700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1877727158228864:0@lo:400: 00010000:00080000:0.0:1790740273.528243:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dc0962a00 x1877727158228736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740273.528251:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc0962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158228736:0@lo:400: 00010000:00080000:0.0:1790740273.528259:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dc0960e00 x1877727158228608/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740273.528266:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc0960e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1877727158228608:0@lo:400: 00000004:00080000:3.0:1790740273.528307:0:8151:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1790740273.528454:0:8151:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 189478881008ns, next at 0ns, rc = 0 00000004:00080000:3.0:1790740273.593982:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:2.0:1790740273.657107:0:8152:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1790740273.657147:0:8152:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db6dc1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8152:1877727158229120:0@lo:7: 00000100:00100000:2.0:1790740273.657223:0:8152:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740273.657241:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db6dc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158228992:0@lo:13: 00000100:00100000:2.0:1790740273.657274:0:8152:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d875843c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790740273.657358:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740273.657382:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158229120 00000100:00100000:3.0:1790740273.657390:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158229120 00000100:00080000:1.0:1790740273.657422:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790740273.657447:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790740273.657473:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db6dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8152:x1877727158229120:12345-0@lo:7: 00000100:00100000:2.0:1790740273.660601:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158228992 00000100:00100000:2.0:1790740273.660620:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158228992 00000100:00100000:2.0:1790740273.660675:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790740273.660686:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8812df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1877727158228992:12345-0@lo:13: 00002000:00000024:2.0:1790740273.660718:0:6704:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1790740273.664607:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8812df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1877727158228992:12345-0@lo:13: Request processed in 3913us (7239us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740273.664637:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1790740273.667430:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0db6dc0000 x1877727158228992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740289 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740273.667479:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db6dc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158228992:0@lo:13: 00002000:00080000:3.0:1790740273.674345:0:6701:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1790740273.674355:0:6701:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00010000:00080000:1.0:1790740273.674595:0:8152:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0db6dc1180 x1877727158229120/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790740289 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740273.674613:0:8152:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db6dc1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8152:1877727158229120:0@lo:7: 00000004:00080000:1.0:1790740273.674629:0:8152:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1790740273.674671:0:8152:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d8812dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8152:1877727158229248:0@lo:5: 00000100:00100000:3.0:1790740273.674675:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db6dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8152:x1877727158229120:12345-0@lo:7: Request processed in 17205us (17448us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740273.674694:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790740273.674712:0:8152:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740273.674771:0:8152:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0dbec32cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790740273.674858:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158229248 00000100:00100000:3.0:1790740273.674865:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158229248 00000100:00100000:3.0:1790740273.674960:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790740273.674970:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8812f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8152:x1877727158229248:12345-0@lo:5: 00002000:00080000:3.0:1790740273.674993:0:6701:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1790740273.674997:0:6701:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1790740273.675220:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8812f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:8152:x1877727158229248:12345-0@lo:5: Request processed in 251us (508us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1790740273.675226:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1790740273.675255:0:8152:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0d8812dc00 x1877727158229248/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790740289 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740273.675267:0:8152:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d8812dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8152:1877727158229248:0@lo:5: 00000004:00080000:3.0:1790740273.675276:0:8152:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1790740273.675387:0:8152:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db5a69500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8152:1877727158229376:0@lo:700: 00000100:00100000:3.0:1790740273.675414:0:8152:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740273.675432:0:8152:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d85cd06c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790740273.675462:0:6708:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158229376 00000100:00100000:3.0:1790740273.675466:0:6708:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158229376 00000100:00100000:3.0:1790740273.675503:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790740273.675511:0:6708:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db5a68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8152:x1877727158229376:12345-0@lo:700: 00000100:00100000:3.0:1790740273.675539:0:6708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db5a6b800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6708:1877727158229504:0@lo:700: 00000100:00100000:3.0:1790740273.675565:0:6708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740273.675604:0:6708:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d85cd0300 going to sleep for 11 seconds 00000100:00100000:3.0:1790740273.675634:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158229504 00000100:00100000:3.0:1790740273.675645:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158229504 00000100:00100000:3.0:1790740273.675671:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790740273.675678:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db5a69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6708:x1877727158229504:12345-0@lo:700: 40000000:02000000:2.0:1790740273.717603:0:5849:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1790740273.723175:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db5a69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6708:x1877727158229504:12345-0@lo:700: Request processed in 47487us (47598us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740273.723191:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1790740273.723375:0:6708:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0db5a6b800 x1877727158229504/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1790740289 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740273.723390:0:6708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db5a6b800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6708:1877727158229504:0@lo:700: 40000000:02000000:0.0:1790740273.723402:0:6708:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:2.0:1790740273.818740:0:7642:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:2.0:1790740273.818757:0:7642:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1790740273.819708:0:6708:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db5a68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8152:x1877727158229376:12345-0@lo:700: Request processed in 144194us (144288us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740273.819731:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1790740273.823898:0:8152:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0db5a69500 x1877727158229376/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1790740289 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740273.823913:0:8152:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1790740273.823930:0:8152:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db5a69500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8152:1877727158229376:0@lo:700: 00000004:02000040:3.0:1790740273.857102:0:8152:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1790740273.859919:0:8152:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db5a69500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8152:1877727158229632:0@lo:5: 00000100:00100000:3.0:1790740273.859986:0:8152:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740273.860042:0:8152:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d848c5480 going to sleep for 11 seconds 00000100:00100000:1.0:1790740273.860758:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158229632 00000100:00100000:1.0:1790740273.860768:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158229632 00000100:00100000:1.0:1790740273.860818:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790740273.860828:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db5a6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8152:x1877727158229632:12345-0@lo:5: 00002000:00080000:3.0:1790740273.866554:0:6700:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1790740273.866795:0:6700:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1790740273.869756:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db5a6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8152:x1877727158229632:12345-0@lo:5: Request processed in 8922us (9763us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1790740273.869768:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1790740273.870117:0:8152:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0db5a69500 x1877727158229632/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790740289 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740273.870147:0:8152:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db5a69500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8152:1877727158229632:0@lo:5: 00000004:00080000:0.0:1790740273.870161:0:8152:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000001:00080000:3.0:1790740274.424937:0:7642:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:3.0:1790740274.480745:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db5a69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158229760:0@lo:13: 00000100:00100000:3.0:1790740274.480815:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740274.480935:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158229760 00000100:00100000:2.0:1790740274.480943:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158229760 00000100:00100000:2.0:1790740274.480994:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790740274.481004:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db5a6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158229760:12345-0@lo:13: 00002000:00000024:2.0:1790740274.481037:0:6704:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790740274.481096:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db5a6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158229760:12345-0@lo:13: Request processed in 94us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740274.481104:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1790740274.481464:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0db5a69c00 x1877727158229760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740290 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740274.481486:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db5a69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158229760:0@lo:13: 00010000:00010000:1.0:1790740274.484188:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740274.969599:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740274.969908:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133040768 00000100:00100000:1.0:1790740274.969918:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133040768 00000100:00100000:1.0:1790740274.969966:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 111 00000100:00100000:1.0:1790740274.969974:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2368:x1877727133040768:12345-192.168.203.58@tcp:250: 00010000:00080000:1.0:1790740274.970003:0:5835:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 7ad096e7-2e76-4f28-9317-dae6d3cb14fe@192.168.203.58@tcp t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:1.0:1790740274.970032:0:5835:0:(genops.c:1384:class_connect()) connect: client 7ad096e7-2e76-4f28-9317-dae6d3cb14fe, cookie 0xc6b31a1b598e9bbc 00000100:00080000:1.0:1790740274.974267:0:5835:0:(import.c:65:import_set_state_nolock()) ffff8f0dc1f20800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790740274.974684:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+5:2368:x1877727133040768:12345-192.168.203.58@tcp:250: Request processed in 4371us (4774us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740274.974698:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 111 00000100:00100000:1.0:1790740274.980617:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740274.980693:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133040896 00000100:00100000:3.0:1790740274.980703:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133040896 00000100:00100000:3.0:1790740274.980753:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 112 00000100:00100000:3.0:1790740274.980762:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+5:5597:x1877727133040896:12345-192.168.203.58@tcp:101: 00010000:00010000:3.0:1790740274.980796:0:5836:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740274.980822:0:5836:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0d9f499800/0xc6b31a1b598e9bc3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee2ef expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740274.980853:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0d9f499800/0xc6b31a1b598e9bc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee2ef expref: 6 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740274.980864:0:5836:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0d9f499800/0xc6b31a1b598e9bc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee2ef expref: 6 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740274.980874:0:5836:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9f499800, rc 0) 00000100:00100000:3.0:1790740274.980930:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+6:5597:x1877727133040896:12345-192.168.203.58@tcp:101: Request processed in 169us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740274.980937:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 112 00000100:00100000:3.0:1790740274.989083:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740274.989220:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133041024 00000100:00100000:1.0:1790740274.989317:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133041024 00000100:00100000:1.0:1790740274.989597:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 113 00000100:00100000:1.0:1790740274.989615:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+6:5597:x1877727133041024:12345-192.168.203.58@tcp:501: 00000100:00100000:1.0:1790740274.989958:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+6:5597:x1877727133041024:12345-192.168.203.58@tcp:501: Request processed in 351us (884us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790740274.989968:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 113 00000100:00100000:3.0:1790740274.995137:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740274.995320:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133041152 00000100:00100000:0.0:1790740274.995331:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133041152 00000100:00100000:0.0:1790740274.995398:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 114 00000100:00100000:0.0:1790740274.995409:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+6:5597:x1877727133041152:12345-192.168.203.58@tcp:101: 00010000:00010000:0.0:1790740274.995425:0:5837:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740274.995452:0:5837:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0d9fea7600/0xc6b31a1b598e9bca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee2f6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740274.995482:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0d9fea7600/0xc6b31a1b598e9bca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee2f6 expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740274.995494:0:5837:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0d9fea7600/0xc6b31a1b598e9bca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee2f6 expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740274.995503:0:5837:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9fea7600, rc 0) 00000100:00100000:0.0:1790740274.995565:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+7:5597:x1877727133041152:12345-192.168.203.58@tcp:101: Request processed in 157us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740274.995588:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 114 00000100:00100000:3.0:1790740275.002094:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740275.002128:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133041280 00000100:00100000:3.0:1790740275.002139:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133041280 00000100:00100000:3.0:1790740275.002759:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 115 00000100:00100000:3.0:1790740275.002772:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+7:5597:x1877727133041280:12345-192.168.203.58@tcp:501: 00000100:00100000:3.0:1790740275.003059:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+8:5597:x1877727133041280:12345-192.168.203.58@tcp:501: Request processed in 290us (976us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740275.003067:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 115 00000100:00100000:2.0:1790740275.014329:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740275.018649:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133041408 00000100:00100000:3.0:1790740275.018665:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133041408 00000100:00100000:0.0:1790740275.022448:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 116 00000100:00100000:0.0:1790740275.022474:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d874ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+8:5597:x1877727133041408:12345-192.168.203.58@tcp:503: 00000100:00100000:0.0:1790740275.022925:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d874ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+8:5597:x1877727133041408:12345-192.168.203.58@tcp:503: Request processed in 464us (8603us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740275.022935:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 116 00000100:00100000:2.0:1790740275.027219:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740275.028224:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133041536 00000100:00100000:3.0:1790740275.028309:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133041536 00000100:00100000:3.0:1790740275.028378:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 117 00000100:00100000:3.0:1790740275.028390:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d874af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+8:5616:x1877727133041536:12345-192.168.203.58@tcp:502: 00000100:00100000:1.0:1790740275.028937:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d874af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+8:5616:x1877727133041536:12345-192.168.203.58@tcp:502: Request processed in 547us (1724us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740275.028946:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 117 00000100:00100000:3.0:1790740275.055456:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740275.056266:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133041664 00000100:00100000:0.0:1790740275.056278:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133041664 00000100:00100000:0.0:1790740275.058126:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 118 00000100:00100000:0.0:1790740275.058152:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d874adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+8:5616:x1877727133041664:12345-192.168.203.58@tcp:502: 00000100:00100000:0.0:1790740275.058481:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d874adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+8:5616:x1877727133041664:12345-192.168.203.58@tcp:502: Request processed in 343us (3044us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740275.058490:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 118 00000100:00100000:3.0:1790740275.071047:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740275.071272:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133041792 00000100:00100000:1.0:1790740275.071284:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133041792 00000100:00100000:1.0:1790740275.071338:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 119 00000100:00100000:1.0:1790740275.071348:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d874ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+8:5597:x1877727133041792:12345-192.168.203.58@tcp:101: 00010000:00010000:1.0:1790740275.071367:0:5837:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740275.071385:0:5837:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0d9f977400/0xc6b31a1b598e9bd1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee320 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740275.071415:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0d9f977400/0xc6b31a1b598e9bd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee320 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740275.071426:0:5837:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0d9f977400/0xc6b31a1b598e9bd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee320 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740275.071435:0:5837:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9f977400, rc 0) 00000100:00100000:1.0:1790740275.071491:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d874ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+9:5597:x1877727133041792:12345-192.168.203.58@tcp:101: Request processed in 145us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740275.071498:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 119 00000100:00100000:2.0:1790740275.075777:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740275.075945:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133041920 00000100:00100000:0.0:1790740275.075956:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133041920 00000100:00100000:0.0:1790740275.076013:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 120 00000100:00100000:0.0:1790740275.076023:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d874ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+9:5597:x1877727133041920:12345-192.168.203.58@tcp:256: 20000000:01000000:0.0:1790740275.076048:0:5835:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1790740275.076073:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1790740275.076078:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1790740275.076081:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1790740275.076083:0:5835:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1790740275.077833:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d874ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+9:5597:x1877727133041920:12345-192.168.203.58@tcp:256: Request processed in 1803us (2058us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740275.077848:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 120 00000100:00100000:0.0:1790740275.082282:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740275.082553:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133042048 00000100:00100000:1.0:1790740275.082601:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133042048 00000100:00100000:1.0:1790740275.082664:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 121 00000100:00100000:1.0:1790740275.082674:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d874ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+9:5597:x1877727133042048:12345-192.168.203.58@tcp:101: 00010000:00010000:1.0:1790740275.082692:0:5837:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740275.082710:0:5837:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0d9f977a00/0xc6b31a1b598e9bd8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee327 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740275.082747:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0d9f977a00/0xc6b31a1b598e9bd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee327 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740275.082759:0:5837:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0d9f977a00/0xc6b31a1b598e9bd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee327 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740275.082768:0:5837:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9f977a00, rc 0) 00000100:00100000:1.0:1790740275.082824:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d874ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+10:5597:x1877727133042048:12345-192.168.203.58@tcp:101: Request processed in 152us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740275.082831:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 121 00000100:00100000:1.0:1790740275.090294:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740275.093734:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133042176 00000100:00100000:1.0:1790740275.093749:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133042176 00000100:00100000:1.0:1790740275.093806:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 122 00000100:00100000:1.0:1790740275.093816:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d874ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+10:5597:x1877727133042176:12345-192.168.203.58@tcp:501: 00000100:00100000:1.0:1790740275.094098:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d874ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+10:5597:x1877727133042176:12345-192.168.203.58@tcp:501: Request processed in 282us (3813us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740275.094107:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 122 00000100:00100000:1.0:1790740275.096429:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740275.096461:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133042304 00000100:00100000:1.0:1790740275.096469:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133042304 00000100:00100000:1.0:1790740275.096529:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 123 00000100:00100000:1.0:1790740275.096543:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d874af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+10:5597:x1877727133042304:12345-192.168.203.58@tcp:503: 00000100:00100000:1.0:1790740275.097245:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d874af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+10:5597:x1877727133042304:12345-192.168.203.58@tcp:503: Request processed in 704us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740275.097255:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 123 00000100:00100000:0.0:1790740275.101608:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740275.101711:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133042432 00000100:00100000:1.0:1790740275.101728:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133042432 00000100:00100000:1.0:1790740275.101846:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 124 00000100:00100000:1.0:1790740275.101861:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d874ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+10:5621:x1877727133042432:12345-192.168.203.58@tcp:502: 00000100:00100000:1.0:1790740275.102199:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d874ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+10:5621:x1877727133042432:12345-192.168.203.58@tcp:502: Request processed in 331us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740275.102207:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 124 00000100:00100000:0.0:1790740275.108105:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740275.108463:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133042560 00000100:00100000:2.0:1790740275.108473:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133042560 00000100:00100000:2.0:1790740275.108528:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 125 00000100:00100000:2.0:1790740275.108538:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d874ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+10:5621:x1877727133042560:12345-192.168.203.58@tcp:502: 00000100:00100000:2.0:1790740275.111379:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d874ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+10:5621:x1877727133042560:12345-192.168.203.58@tcp:502: Request processed in 2715us (3154us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740275.111414:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 125 00000100:00100000:1.0:1790740275.117669:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740275.117738:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740275.117912:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133042688 00000100:00100000:0.0:1790740275.117922:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133042688 00000100:00100000:0.0:1790740275.117961:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 4 00000100:00100000:0.0:1790740275.117970:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8812dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2368:x1877727133042688:12345-192.168.203.58@tcp:38: 00010000:00080000:0.0:1790740275.117999:0:5842:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from ec599375-3198-45fd-a23a-c5620f07177c@192.168.203.58@tcp t0 exp 0000000000000000 cur 191 last 0 00000020:00000080:0.0:1790740275.118047:0:5842:0:(genops.c:1384:class_connect()) connect: client ec599375-3198-45fd-a23a-c5620f07177c, cookie 0xc6b31a1b598e9bdf 00000004:00100000:0.0:1790740275.118081:0:5842:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1790740275.118087:0:5842:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1790740275.118428:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133043072 00000100:00100000:2.0:1790740275.118433:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133043072 00000100:00100000:2.0:1790740275.118469:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 126 00000100:00100000:2.0:1790740275.118475:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d874ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+10:2370:x1877727133043072:12345-192.168.203.58@tcp:400: 00000100:00100000:2.0:1790740275.118535:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d874ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+10:2370:x1877727133043072:12345-192.168.203.58@tcp:400: Request processed in 59us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740275.118541:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 126 00000100:00080000:3.0:1790740275.154779:0:5842:0:(import.c:65:import_set_state_nolock()) ffff8f0dc1a87000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790740275.156672:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8812dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+6:2368:x1877727133042688:12345-192.168.203.58@tcp:38: Request processed in 38690us (39000us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740275.156687:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 4 00010000:00010000:3.0:1790740275.505512:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740276.166129:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740276.166241:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740276.166328:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133042816 00000100:00100000:3.0:1790740276.166338:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133042816 00000100:00100000:3.0:1790740276.166400:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133042944 00000100:00100000:3.0:1790740276.166403:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133042944 00000100:00100000:3.0:1790740276.166420:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 5 00000100:00100000:3.0:1790740276.166429:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8812d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+7:0:x1877727133042816:12345-192.168.203.58@tcp:41: 00000004:00000024:3.0:1790740276.166476:0:5844:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1790740276.166540:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8812d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+7:0:x1877727133042816:12345-192.168.203.58@tcp:41: Request processed in 111us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740276.166547:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 5 00000100:00100000:3.0:1790740276.166570:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 6 00000100:00100000:3.0:1790740276.166605:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8498ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+6:5597:x1877727133042944:12345-192.168.203.58@tcp:41: 00000004:00000024:3.0:1790740276.166618:0:5844:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1790740276.166678:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8498ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+6:5597:x1877727133042944:12345-192.168.203.58@tcp:41: Request processed in 71us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740276.166684:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 6 00000100:00080000:1.0:1790740276.167483:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790740276.174584:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740276.174875:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133043200 00000100:00100000:2.0:1790740276.174885:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133043200 00000100:00100000:2.0:1790740276.174944:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 7 00000100:00100000:2.0:1790740276.174954:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8498e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+6:5597:x1877727133043200:12345-192.168.203.58@tcp:40: 00000100:00100000:2.0:1790740276.175373:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8498e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+6:5597:x1877727133043200:12345-192.168.203.58@tcp:40: Request processed in 419us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740276.175382:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 7 00000100:00100000:2.0:1790740276.179888:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740276.179926:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740276.179958:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740276.179994:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740276.180022:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133043712 00000100:00100000:2.0:1790740276.180031:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133043712 00000100:00100000:2.0:1790740276.180086:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 127 00000100:00100000:2.0:1790740276.180095:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d874af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+10:2371:x1877727133043712:12345-192.168.203.58@tcp:400: 00000100:00100000:2.0:1790740276.180174:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d874af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+10:2371:x1877727133043712:12345-192.168.203.58@tcp:400: Request processed in 79us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740276.180191:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133043328 00000100:00100000:2.0:1790740276.180196:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 127 00000100:00100000:0.0:1790740276.180199:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133043328 00000100:00100000:0.0:1790740276.180224:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133043456 00000100:00100000:0.0:1790740276.180228:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133043456 00000100:00100000:0.0:1790740276.180245:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 8 00000100:00100000:0.0:1790740276.180252:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db6dc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2368:x1877727133043328:12345-192.168.203.58@tcp:8: 00010000:00080000:0.0:1790740276.180277:0:6701:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from ec599375-3198-45fd-a23a-c5620f07177c@192.168.203.58@tcp t0 exp 0000000000000000 cur 192 last 0 00000020:00000080:0.0:1790740276.180313:0:6701:0:(genops.c:1384:class_connect()) connect: client ec599375-3198-45fd-a23a-c5620f07177c, cookie 0xc6b31a1b598e9be6 00002000:00100000:0.0:1790740276.180326:0:6701:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ec599375-3198-45fd-a23a-c5620f07177c/ffff8f0db6f4b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790740276.180350:0:6701:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1790740276.180362:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133043584 00000100:00100000:3.0:1790740276.180373:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133043584 00000100:00100000:3.0:1790740276.180415:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 0 00000100:00100000:3.0:1790740276.180423:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db6dc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec599375-3198-45fd-a23a-c5620f07177c+6:5597:x1877727133043584:12345-192.168.203.58@tcp:33: 00002000:00080000:0.0:1790740276.180842:0:6701:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1790740276.180872:0:6701:0:(import.c:65:import_set_state_nolock()) ffff8f0db6f4f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790740276.180997:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db6dc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec599375-3198-45fd-a23a-c5620f07177c+6:2368:x1877727133043328:12345-192.168.203.58@tcp:8: Request processed in 731us (1057us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740276.181006:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 8 00000100:00100000:0.0:1790740276.181026:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 9 00000100:00100000:0.0:1790740276.181031:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db6dc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2368:x1877727133043456:12345-192.168.203.58@tcp:8: 00010000:00080000:0.0:1790740276.181049:0:6701:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from ec599375-3198-45fd-a23a-c5620f07177c@192.168.203.58@tcp t0 exp 0000000000000000 cur 192 last 0 00000020:00000080:0.0:1790740276.181075:0:6701:0:(genops.c:1384:class_connect()) connect: client ec599375-3198-45fd-a23a-c5620f07177c, cookie 0xc6b31a1b598e9bed 00002000:00100000:0.0:1790740276.181081:0:6701:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ec599375-3198-45fd-a23a-c5620f07177c/ffff8f0db6f49000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790740276.181097:0:6701:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790740276.181363:0:6701:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1790740276.181382:0:6701:0:(import.c:65:import_set_state_nolock()) ffff8f0db6f49800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790740276.181412:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db6dc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec599375-3198-45fd-a23a-c5620f07177c+6:2368:x1877727133043456:12345-192.168.203.58@tcp:8: Request processed in 379us (1453us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740276.181428:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 9 00000004:00080000:2.0:1790740276.201696:0:5845:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 21200us 00000004:00200000:2.0:1790740276.225080:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1790740276.225214:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db6dc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec599375-3198-45fd-a23a-c5620f07177c+6:5597:x1877727133043584:12345-192.168.203.58@tcp:33: Request processed in 44787us (45329us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740276.225238:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 0 00000100:00100000:1.0:1790740276.483143:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740276.483268:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133043840 00000100:00100000:0.0:1790740276.483277:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133043840 00000100:00100000:0.0:1790740276.483343:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 8 00000100:00100000:0.0:1790740276.483353:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8498f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+6:5638:x1877727133043840:12345-192.168.203.58@tcp:101: 00010000:00010000:0.0:1790740276.483373:0:5843:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740276.483422:0:5843:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6400/0xc6b31a1b598e9bf4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee351 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740276.483486:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6600/0xc6b31a1b598e9bfb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740276.483499:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6600/0xc6b31a1b598e9bfb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740276.483515:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6600/0xc6b31a1b598e9bfb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790740276.483549:0:5843:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790740276.483553:0:5843:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790740276.483627:0:5843:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6600/0xc6b31a1b598e9bfb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740276.483654:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6400/0xc6b31a1b598e9bf4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee351 expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740276.483672:0:5843:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6600/0xc6b31a1b598e9bfb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee351 expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740276.483708:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0d84bf8a00) 00010000:00010000:0.0:1790740276.483712:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790740276.483715:0:5843:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9fea6600, rc 0) 00000100:00100000:0.0:1790740276.483768:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8498f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+7:5638:x1877727133043840:12345-192.168.203.58@tcp:101: Request processed in 416us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740276.483776:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 8 00010000:00010000:1.0:1790740276.528858:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740277.552898:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740278.576762:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740278.576904:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d98510700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877727158230016:0@lo:400: 00000100:00100000:3.0:1790740278.576925:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d98511f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1877727158230144:0@lo:400: 00000100:00100000:0.0:1790740278.577006:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db5a69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3304:1877727158229888:0@lo:400: 00000100:00100000:1.0:1790740278.577068:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d98512a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158230272:0@lo:400: 00000100:00100000:3.0:1790740278.578895:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740278.579052:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740278.579110:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d98511500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158230528:0@lo:400: 00000100:00100000:2.0:1790740278.579150:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740278.579205:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158230528 00000100:00100000:2.0:1790740278.579213:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158230528 00000100:00100000:3.0:1790740278.579237:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158230144 00000100:00100000:3.0:1790740278.579243:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158230144 00000100:00100000:2.0:1790740278.579273:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790740278.579281:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158230016 00000100:00100000:3.0:1790740278.579285:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158230016 00000100:00100000:2.0:1790740278.579286:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db6dc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158230528:12345-0@lo:400: 00000100:00100000:3.0:1790740278.579304:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790740278.579322:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d98513480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877727158230144:12345-0@lo:400: 00000100:00100000:3.0:1790740278.579377:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d98513480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877727158230144:12345-0@lo:400: Request processed in 67us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740278.579644:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790740278.579674:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790740278.579683:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db6dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877727158230016:12345-0@lo:400: 00000100:00100000:2.0:1790740278.579709:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db6dc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158230528:12345-0@lo:400: Request processed in 425us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740278.579718:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790740278.579733:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db6dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877727158230016:12345-0@lo:400: Request processed in 51us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740278.579740:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1790740278.579741:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790740278.579747:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790740278.579789:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d98511f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1877727158230144:0@lo:400: 00010000:00080000:2.0:1790740278.579801:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0d98511500 x1877727158230528/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740278.579812:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1790740278.579826:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d98511500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158230528:0@lo:400: 00000100:00100000:2.0:1790740278.579857:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d98510700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877727158230016:0@lo:400: 00000100:00100000:0.0:1790740278.579932:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740278.579969:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d98511c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1877727158230400:0@lo:400: 00000100:00100000:0.0:1790740278.579995:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740278.580101:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158230400 00000100:00100000:2.0:1790740278.580107:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158230400 00000100:00100000:2.0:1790740278.580149:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790740278.580155:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc0960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1877727158230400:12345-0@lo:400: 00000100:00100000:2.0:1790740278.580205:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc0960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1877727158230400:12345-0@lo:400: Request processed in 50us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740278.580211:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1790740278.580231:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790740278.580261:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d98511c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1877727158230400:0@lo:400: 00000100:00100000:3.0:1790740278.580324:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158229888 00000100:00100000:3.0:1790740278.580329:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158229888 00000100:00100000:3.0:1790740278.580364:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1790740278.580370:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d84877850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3304:x1877727158229888:12345-0@lo:400: 00000100:00100000:3.0:1790740278.580424:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d84877850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3304:x1877727158229888:12345-0@lo:400: Request processed in 53us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740278.580437:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1790740278.580561:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db5a69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3304:1877727158229888:0@lo:400: 00000100:00100000:1.0:1790740278.583198:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740278.586264:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158230272 00000100:00100000:0.0:1790740278.586280:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158230272 00000100:00100000:0.0:1790740278.586441:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790740278.586452:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8498fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158230272:12345-0@lo:400: 00000100:00100000:0.0:1790740278.586549:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8498fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158230272:12345-0@lo:400: Request processed in 99us (3359us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740278.586556:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1790740278.587526:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0d98512a00 x1877727158230272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740278.587544:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d98512a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158230272:0@lo:400: 00000100:00080000:2.0:1790740278.591863:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790740278.803928:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740278.805805:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133043968 00000100:00100000:0.0:1790740278.805820:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133043968 00000100:00100000:0.0:1790740278.805920:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 9 00000100:00100000:0.0:1790740278.805932:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8498e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+7:5690:x1877727133043968:12345-192.168.203.58@tcp:41: 00000004:00000024:0.0:1790740278.805999:0:5843:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1790740278.806087:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8498e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+7:5690:x1877727133043968:12345-192.168.203.58@tcp:41: Request processed in 157us (2168us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740278.806096:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 9 00000100:00080000:2.0:1790740278.806348:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790740278.819775:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740278.819902:0:6703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133044096 00000100:00100000:3.0:1790740278.819913:0:6703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133044096 00000100:00100000:3.0:1790740278.819999:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 7 00000100:00100000:3.0:1790740278.820010:0:6703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8498c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec599375-3198-45fd-a23a-c5620f07177c+6:5690:x1877727133044096:12345-192.168.203.58@tcp:13: 00002000:00000024:3.0:1790740278.820047:0:6703:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790740278.820117:0:6703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8498c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec599375-3198-45fd-a23a-c5620f07177c+6:5690:x1877727133044096:12345-192.168.203.58@tcp:13: Request processed in 109us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740278.820123:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 7 00000100:00080000:2.0:1790740278.820272:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790740278.826381:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740278.826470:0:6703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133044224 00000100:00100000:3.0:1790740278.826489:0:6703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133044224 00000100:00100000:3.0:1790740278.826566:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 8 00000100:00100000:3.0:1790740278.826610:0:6703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8498ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec599375-3198-45fd-a23a-c5620f07177c+6:5690:x1877727133044224:12345-192.168.203.58@tcp:13: 00002000:00000024:3.0:1790740278.826649:0:6703:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790740278.826719:0:6703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8498ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec599375-3198-45fd-a23a-c5620f07177c+6:5690:x1877727133044224:12345-192.168.203.58@tcp:13: Request processed in 111us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740278.826726:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 8 00000100:00080000:2.0:1790740278.827062:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790740279.089445:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc0962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158230656:0@lo:13: 00000100:00100000:3.0:1790740279.089537:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740279.089798:0:6703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158230656 00000100:00100000:0.0:1790740279.089808:0:6703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158230656 00000100:00100000:0.0:1790740279.089863:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790740279.089872:0:6703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d98511f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877727158230656:12345-0@lo:13: 00002000:00000024:0.0:1790740279.089893:0:6703:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790740279.089945:0:6703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d98511f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877727158230656:12345-0@lo:13: Request processed in 74us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740279.089952:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1790740279.090106:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dc0962a00 x1877727158230656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740295 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740279.090125:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc0962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158230656:0@lo:13: 00000001:00100000:2.0:1790740279.155505:0:6725:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ec599375-3198-45fd-a23a-c5620f07177c 00010000:00010000:0.0:1790740279.601670:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740279.606318:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc0960700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158230784:0@lo:13: 00000100:00100000:0.0:1790740279.606395:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740279.606466:0:6703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158230784 00000100:00100000:0.0:1790740279.606476:0:6703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158230784 00000100:00100000:0.0:1790740279.606522:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790740279.606531:0:6703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc0960380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158230784:12345-0@lo:13: 00002000:00000024:0.0:1790740279.606552:0:6703:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790740279.606611:0:6703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc0960380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158230784:12345-0@lo:13: Request processed in 81us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740279.606618:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1790740279.606660:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dc0960700 x1877727158230784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740295 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740279.606693:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc0960700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158230784:0@lo:13: 00000001:00100000:3.0:1790740280.163954:0:7642:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ec599375-3198-45fd-a23a-c5620f07177c 00010000:00010000:1.0:1790740280.625183:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1790740280.689175:0:5865:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ec599375-3198-45fd-a23a-c5620f07177c 00000100:00100000:1.0:1790740281.237311:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740281.237345:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740281.237380:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740281.237405:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740281.237431:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133044608 00000100:00100000:1.0:1790740281.237440:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133044608 00000100:00100000:1.0:1790740281.237495:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133044736 00000100:00100000:1.0:1790740281.237498:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133044736 00000100:00100000:1.0:1790740281.237513:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 6 00000100:00100000:1.0:1790740281.237524:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8498d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec599375-3198-45fd-a23a-c5620f07177c+5:2370:x1877727133044608:12345-192.168.203.58@tcp:400: 00000100:00100000:1.0:1790740281.237631:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8498d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec599375-3198-45fd-a23a-c5620f07177c+5:2370:x1877727133044608:12345-192.168.203.58@tcp:400: Request processed in 109us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740281.237639:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 6 00000100:00100000:1.0:1790740281.237658:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 7 00000100:00100000:1.0:1790740281.237674:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8498d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec599375-3198-45fd-a23a-c5620f07177c+5:2370:x1877727133044736:12345-192.168.203.58@tcp:400: 00000100:00100000:1.0:1790740281.237699:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8498d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec599375-3198-45fd-a23a-c5620f07177c+5:2370:x1877727133044736:12345-192.168.203.58@tcp:400: Request processed in 35us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740281.237704:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 7 00000100:00100000:1.0:1790740281.237723:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133044480 00000100:00100000:1.0:1790740281.237726:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133044480 00000100:00100000:1.0:1790740281.237751:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 20 00000100:00100000:1.0:1790740281.237758:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8498ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+6:2370:x1877727133044480:12345-192.168.203.58@tcp:400: 00000100:00100000:1.0:1790740281.237799:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8498ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+6:2370:x1877727133044480:12345-192.168.203.58@tcp:400: Request processed in 42us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740281.237807:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 20 00000100:00080000:1.0:1790740281.237823:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790740281.237827:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790740281.237829:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790740281.238111:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133044352 00000100:00100000:3.0:1790740281.238123:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133044352 00000100:00100000:3.0:1790740281.238173:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 129 00000100:00100000:3.0:1790740281.238180:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d84877c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+10:2370:x1877727133044352:12345-192.168.203.58@tcp:400: 00000100:00100000:3.0:1790740281.238209:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d84877c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+10:2370:x1877727133044352:12345-192.168.203.58@tcp:400: Request processed in 30us (915us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740281.238215:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 129 00000001:02000400:3.0:1790740281.575694:0:8293:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1790740281.662437:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740282.672777:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740283.696769:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740283.697330:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc0963480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158231296:0@lo:400: 00000100:00100000:0.0:1790740283.697415:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740283.697484:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1790740283.697491:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc0960700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3303:1877727158230912:0@lo:400: 00000100:00100000:0.0:1790740283.697518:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740283.697541:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc0962680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1877727158231424:0@lo:400: 00000100:00100000:0.0:1790740283.697601:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740283.697632:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc0961f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877727158231040:0@lo:400: 00000100:00100000:0.0:1790740283.697655:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740283.697684:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc0963b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158231552:0@lo:400: 00000100:00100000:0.0:1790740283.697704:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740283.697722:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790740283.697728:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc0961c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1877727158231168:0@lo:400: 00000100:00100000:0.0:1790740283.697748:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740283.697776:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158231296 00000100:00100000:0.0:1790740283.697784:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158231296 00000100:00100000:0.0:1790740283.697832:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158231552 00000100:00100000:0.0:1790740283.697835:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158231552 00000100:00100000:0.0:1790740283.697853:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790740283.697862:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc0962a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158231296:12345-0@lo:400: 00000100:00100000:0.0:1790740283.697911:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc0962a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158231296:12345-0@lo:400: Request processed in 50us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740283.697919:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790740283.697935:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790740283.697941:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d84916a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158231552:12345-0@lo:400: 00000100:00100000:0.0:1790740283.697981:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d84916a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158231552:12345-0@lo:400: Request processed in 41us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740283.697987:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790740283.698080:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158230912 00000100:00100000:0.0:1790740283.698085:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158230912 00000100:00100000:0.0:1790740283.698112:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1790740283.698119:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d84876c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3303:x1877727158230912:12345-0@lo:400: 00000100:00100000:0.0:1790740283.698163:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d84876c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3303:x1877727158230912:12345-0@lo:400: Request processed in 45us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740283.698170:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1790740283.698197:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158231424 00000100:00100000:0.0:1790740283.698200:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158231424 00000100:00100000:0.0:1790740283.698218:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158231040 00000100:00100000:0.0:1790740283.698221:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158231040 00000100:00100000:0.0:1790740283.698229:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158231168 00000100:00100000:0.0:1790740283.698232:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158231168 00000100:00100000:0.0:1790740283.698246:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790740283.698252:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d84914700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877727158231424:12345-0@lo:400: 00000100:00100000:0.0:1790740283.698281:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d84914700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877727158231424:12345-0@lo:400: Request processed in 29us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740283.698287:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790740283.698298:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790740283.698303:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d84915f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877727158231040:12345-0@lo:400: 00000100:00100000:0.0:1790740283.698329:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d84915f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877727158231040:12345-0@lo:400: Request processed in 26us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740283.698335:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790740283.698346:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790740283.698352:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d84915c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877727158231168:12345-0@lo:400: 00000100:00100000:0.0:1790740283.698389:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d84915c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877727158231168:12345-0@lo:400: Request processed in 38us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740283.698396:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1790740283.698420:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790740283.698425:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790740283.698427:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790740283.698457:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc0960700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3303:1877727158230912:0@lo:400: 00000100:00100000:0.0:1790740283.698471:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc0962680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1877727158231424:0@lo:400: 00010000:00080000:0.0:1790740283.698483:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dc0963480 x1877727158231296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740299 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740283.698494:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc0963480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158231296:0@lo:400: 00000100:00100000:0.0:1790740283.698528:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc0961c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1877727158231168:0@lo:400: 00000100:00100000:0.0:1790740283.698537:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc0961f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877727158231040:0@lo:400: 00010000:00080000:0.0:1790740283.698546:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dc0963b80 x1877727158231552/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740299 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740283.698555:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc0963b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158231552:0@lo:400: 00000100:00100000:3.0:1790740284.212584:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d84915500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158231680:0@lo:13: 00000100:00100000:3.0:1790740284.212655:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740284.212871:0:6703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158231680 00000100:00100000:0.0:1790740284.212880:0:6703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158231680 00000100:00100000:0.0:1790740284.212926:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790740284.212936:0:6703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d98512d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877727158231680:12345-0@lo:13: 00002000:00000024:0.0:1790740284.212970:0:6703:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790740284.218561:0:6703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d98512d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877727158231680:12345-0@lo:13: Request processed in 5604us (5884us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740284.218591:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1790740284.220899:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0d84915500 x1877727158231680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740300 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740284.220924:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d84915500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158231680:0@lo:13: 00010000:00010000:1.0:1790740284.720712:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740284.721277:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d84917480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158231808:0@lo:13: 00000100:00100000:1.0:1790740284.721344:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740284.721457:0:6703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158231808 00000100:00100000:0.0:1790740284.721465:0:6703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158231808 00000100:00100000:0.0:1790740284.721518:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790740284.721528:0:6703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8498c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158231808:12345-0@lo:13: 00002000:00000024:0.0:1790740284.721563:0:6703:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790740284.721639:0:6703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8498c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158231808:12345-0@lo:13: Request processed in 112us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740284.721654:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1790740284.721769:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0d84917480 x1877727158231808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740300 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740284.721790:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d84917480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158231808:0@lo:13: 00000020:00000080:1.0:1790740285.524177:0:8441:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc421a6080 20000000:00000080:1.0:1790740285.524195:0:8441:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f0dbee3f800 uarg=0000000000000000 20000000:01000000:1.0:1790740285.524240:0:8441:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1790740285.524243:0:8441:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1790740285.524245:0:8441:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1790740285.524250:0:8441:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1790740285.524255:0:8441:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1790740285.524270:0:8441:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1790740285.524273:0:8441:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1790740285.524464:0:8441:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1790740285.524467:0:8441:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1790740285.526245:0:8442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1790740285.527168:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1790740285.527329:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1790740285.527367:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:1.0:1790740285.527381:0:8441:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1790740285.527384:0:8441:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1790740285.529736:0:8443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1790740285.530375:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1790740285.530421:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1790740285.530463:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:3.0:1790740285.530475:0:8441:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1790740285.530478:0:8441:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1790740285.531979:0:8444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1790740285.533182:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1790740285.533960:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1790740285.534012:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:1.0:1790740285.534041:0:8441:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1790740285.534044:0:8441:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1790740285.535326:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1790740285.536314:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:1.0:1790740285.536382:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:1.0:1790740285.536416:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:1.0:1790740285.536431:0:8441:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1790740285.536453:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f0d9f977000/0xc6b31a1b598e9c02 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740285.536472:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0d9f976a00/0xc6b31a1b598e9aff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e9af8 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740285.536481:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0d9f498200/0xc6b31a1b598e9b29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e9b22 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740285.536488:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0d9fea7c00/0xc6b31a1b598e9b53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e9b4c expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740285.536494:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0d9f976c00/0xc6b31a1b598e9b61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e9b5a expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740285.536500:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0d9f977e00/0xc6b31a1b598e9b6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e9b68 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740285.536517:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0d9fea6200/0xc6b31a1b598e9b8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e9b84 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740285.536524:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0d9f977600/0xc6b31a1b598e9bae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e9ba7 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740285.536533:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0d9f499800/0xc6b31a1b598e9bc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee2ef expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740285.536552:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0d9fea7600/0xc6b31a1b598e9bca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee2f6 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740285.536560:0:8441:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f0d9f977000/0xc6b31a1b598e9c02 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740285.536978:0:8441:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0d9fea7600/0xc6b31a1b598e9bca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee2f6 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740285.536996:0:8441:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f0d9fea7600/0xc6b31a1b598e9bca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee2f6 expref: 9 pid: 5837 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740285.537011:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d8498f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1877727158231936:192.168.203.58@tcp:104: 00010000:00010000:1.0:1790740285.537168:0:8441:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0d9f499800/0xc6b31a1b598e9bc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee2ef expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740285.537177:0:8441:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f0d9f499800/0xc6b31a1b598e9bc3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee2ef expref: 9 pid: 5836 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740285.537186:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d8498c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1877727158232064:192.168.203.58@tcp:104: 00010000:00010000:1.0:1790740285.537229:0:8441:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0d9f977600/0xc6b31a1b598e9bae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b31a1b598e9ba7 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740285.537238:0:8441:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f0d9f977600/0xc6b31a1b598e9bae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b31a1b598e9ba7 expref: 18 pid: 5835 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740285.537246:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d8498df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1877727158232192:0@lo:104: 00000100:00100000:1.0:1790740285.537282:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790740285.537331:0:8441:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0d9fea6200/0xc6b31a1b598e9b8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b31a1b598e9b84 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740285.537339:0:8441:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f0d9fea6200/0xc6b31a1b598e9b8b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b31a1b598e9b84 expref: 18 pid: 5837 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740285.537346:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d8498dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1877727158232320:0@lo:104: 00000100:00100000:1.0:1790740285.537369:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790740285.537386:0:8441:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0d9f977e00/0xc6b31a1b598e9b6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b31a1b598e9b68 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740285.537393:0:8441:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f0d9f977e00/0xc6b31a1b598e9b6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b31a1b598e9b68 expref: 18 pid: 5837 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740285.537400:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d8498d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1877727158232448:0@lo:104: 00010000:00010000:1.0:1790740285.537419:0:8441:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0d9f976c00/0xc6b31a1b598e9b61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b31a1b598e9b5a expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740285.537425:0:8441:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f0d9f976c00/0xc6b31a1b598e9b61 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b31a1b598e9b5a expref: 18 pid: 5836 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740285.537432:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d8498f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1877727158232576:0@lo:104: 00010000:00010000:1.0:1790740285.537472:0:8441:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0d9fea7c00/0xc6b31a1b598e9b53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b31a1b598e9b4c expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740285.537479:0:8441:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f0d9fea7c00/0xc6b31a1b598e9b53 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b31a1b598e9b4c expref: 18 pid: 5835 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740285.537487:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a41c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1877727158232704:0@lo:104: 00010000:00010000:1.0:1790740285.537521:0:8441:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0d9f498200/0xc6b31a1b598e9b29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b31a1b598e9b22 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740285.537536:0:8441:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f0d9f498200/0xc6b31a1b598e9b29 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b31a1b598e9b22 expref: 18 pid: 5836 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740285.537544:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a41500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1877727158232832:0@lo:104: 00010000:00010000:1.0:1790740285.537603:0:8441:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0d9f976a00/0xc6b31a1b598e9aff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b31a1b598e9af8 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740285.537612:0:8441:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f0d9f976a00/0xc6b31a1b598e9aff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b31a1b598e9af8 expref: 18 pid: 5836 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740285.537619:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a43480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1877727158232960:0@lo:104: 00000100:00100000:1.0:1790740285.537645:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d98019840 going to sleep for 11 seconds 00000100:00100000:0.0:1790740285.537897:0:5826:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1790740285.537916:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740285.537928:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740285.537935:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740285.537942:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740285.537948:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740285.537955:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158232192 00000100:00100000:0.0:1790740285.537961:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158232192 00000100:00100000:0.0:1790740285.537992:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158232320 00000100:00100000:0.0:1790740285.537995:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158232320 00000100:00100000:0.0:1790740285.538002:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158232448 00000100:00100000:0.0:1790740285.538004:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158232448 00000100:00100000:0.0:1790740285.538011:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158232576 00000100:00100000:0.0:1790740285.538014:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158232576 00000100:00100000:0.0:1790740285.538022:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158232704 00000100:00100000:0.0:1790740285.538024:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158232704 00000100:00100000:0.0:1790740285.538031:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158232832 00000100:00100000:0.0:1790740285.538033:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158232832 00000100:00100000:0.0:1790740285.538041:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158232960 00000100:00100000:0.0:1790740285.538043:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158232960 00000100:00100000:0.0:1790740285.538055:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790740285.538063:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8498ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+9:8441:x1877727158232192:12345-0@lo:104: 00010000:00010000:0.0:1790740285.538078:0:5826:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3e00/0xc6b31a1b598e9ba7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598e9bae expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.538156:0:5826:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790740285.538162:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8498ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+9:8441:x1877727158232192:12345-0@lo:104: Request processed in 100us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740285.538170:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790740285.538188:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790740285.538194:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db6c22450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+8:8441:x1877727158232320:12345-0@lo:104: 00010000:00010000:0.0:1790740285.538213:0:5826:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976600/0xc6b31a1b598e9b84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598e9b8b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.538245:0:5826:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790740285.538250:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db6c22450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+8:8441:x1877727158232320:12345-0@lo:104: Request processed in 57us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740285.538255:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790740285.538283:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790740285.538289:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d84916d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+7:8441:x1877727158232448:12345-0@lo:104: 00010000:00010000:0.0:1790740285.538296:0:5826:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977c00/0xc6b31a1b598e9b68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598e9b6f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.538318:0:5826:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1790740285.538322:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d84916d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+7:8441:x1877727158232448:12345-0@lo:104: Request processed in 35us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740285.538327:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790740285.538338:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790740285.538342:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d84916680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+6:8441:x1877727158232576:12345-0@lo:104: 00010000:00010000:0.0:1790740285.538348:0:5826:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d2c00/0xc6b31a1b598e9b5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598e9b61 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.538380:0:5826:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1790740285.538384:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d84916680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+6:8441:x1877727158232576:12345-0@lo:104: Request processed in 42us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740285.538390:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790740285.538400:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790740285.538405:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d84917100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+5:8441:x1877727158232704:12345-0@lo:104: 00010000:00010000:0.0:1790740285.538412:0:5826:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499400/0xc6b31a1b598e9b4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598e9b53 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.538434:0:5826:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1790740285.538439:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d84917100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+5:8441:x1877727158232704:12345-0@lo:104: Request processed in 34us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740285.538444:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790740285.538454:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790740285.538460:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d84917b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+4:8441:x1877727158232832:12345-0@lo:104: 00010000:00010000:0.0:1790740285.538466:0:5826:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7800/0xc6b31a1b598e9b22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598e9b29 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.538489:0:5826:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1790740285.538493:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d84917b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+4:8441:x1877727158232832:12345-0@lo:104: Request processed in 35us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740285.538499:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790740285.538509:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790740285.538515:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d84916300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+3:8441:x1877727158232960:12345-0@lo:104: 00010000:00010000:0.0:1790740285.538521:0:5826:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.158@tcp lock: ffff8f0d9f498600/0xc6b31a1b598e9af8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598e9aff expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.538552:0:5826:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1790740285.538556:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d84916300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+3:8441:x1877727158232960:12345-0@lo:104: Request processed in 43us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740285.538563:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1790740285.538611:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1790740285.538616:0:5832:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3e00/0xc6b31a1b598e9ba7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598e9bae expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.538623:0:5832:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc21d3e00 already unused, calling callback (ffffffffc1baec20) 10000000:00010000:0.0:1790740285.538627:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3e00/0xc6b31a1b598e9ba7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b31a1b598e9bae expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.538635:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3e00/0xc6b31a1b598e9ba7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b31a1b598e9bae expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790740285.538642:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3e00/0xc6b31a1b598e9ba7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b31a1b598e9bae expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740285.538649:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790740285.538677:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3e00/0xc6b31a1b598e9ba7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9bae expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.538683:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790740285.538701:0:5832:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3e00/0xc6b31a1b598e9ba7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9bae expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.538708:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3e00/0xc6b31a1b598e9ba7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9bae expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.538732:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1790740285.538736:0:5832:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976600/0xc6b31a1b598e9b84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598e9b8b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.538753:0:5832:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f976600 already unused, calling callback (ffffffffc1baec20) 10000000:00010000:0.0:1790740285.538756:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976600/0xc6b31a1b598e9b84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b31a1b598e9b8b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.538762:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976600/0xc6b31a1b598e9b84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b31a1b598e9b8b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790740285.538768:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976600/0xc6b31a1b598e9b84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b31a1b598e9b8b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740285.538772:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790740285.538786:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976600/0xc6b31a1b598e9b84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9b8b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.538792:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790740285.538808:0:5832:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976600/0xc6b31a1b598e9b84 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9b8b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.538813:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976600/0xc6b31a1b598e9b84 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9b8b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.538826:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1790740285.538829:0:5832:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977c00/0xc6b31a1b598e9b68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598e9b6f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.538843:0:5832:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f977c00 already unused, calling callback (ffffffffc1baec20) 10000000:00010000:0.0:1790740285.538846:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977c00/0xc6b31a1b598e9b68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b31a1b598e9b6f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.538851:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977c00/0xc6b31a1b598e9b68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b31a1b598e9b6f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790740285.538856:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977c00/0xc6b31a1b598e9b68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b31a1b598e9b6f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740285.538862:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790740285.538873:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977c00/0xc6b31a1b598e9b68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9b6f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.538878:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790740285.538883:0:5832:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977c00/0xc6b31a1b598e9b68 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9b6f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.538889:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977c00/0xc6b31a1b598e9b68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9b6f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.538901:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1790740285.538905:0:5832:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d2c00/0xc6b31a1b598e9b5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598e9b61 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.538911:0:5832:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc21d2c00 already unused, calling callback (ffffffffc1baec20) 10000000:00010000:0.0:1790740285.538914:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d2c00/0xc6b31a1b598e9b5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b31a1b598e9b61 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.538929:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d2c00/0xc6b31a1b598e9b5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b31a1b598e9b61 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790740285.538936:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d2c00/0xc6b31a1b598e9b5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b31a1b598e9b61 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740285.538942:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790740285.538955:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d2c00/0xc6b31a1b598e9b5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9b61 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.538960:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790740285.538965:0:5832:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d2c00/0xc6b31a1b598e9b5a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9b61 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.538971:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d2c00/0xc6b31a1b598e9b5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9b61 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.538981:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1790740285.538983:0:5832:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499400/0xc6b31a1b598e9b4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598e9b53 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.538989:0:5832:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f499400 already unused, calling callback (ffffffffc1baec20) 10000000:00010000:0.0:1790740285.538992:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499400/0xc6b31a1b598e9b4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b31a1b598e9b53 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.538999:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499400/0xc6b31a1b598e9b4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b31a1b598e9b53 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790740285.539005:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499400/0xc6b31a1b598e9b4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b31a1b598e9b53 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740285.539016:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790740285.539028:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499400/0xc6b31a1b598e9b4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9b53 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.539034:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790740285.539038:0:5832:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499400/0xc6b31a1b598e9b4c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9b53 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.539044:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499400/0xc6b31a1b598e9b4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9b53 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.539054:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790740285.539056:0:5832:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7800/0xc6b31a1b598e9b22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598e9b29 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.539062:0:5832:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9fea7800 already unused, calling callback (ffffffffc1baec20) 10000000:00010000:0.0:1790740285.539065:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7800/0xc6b31a1b598e9b22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b31a1b598e9b29 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.539072:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7800/0xc6b31a1b598e9b22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b31a1b598e9b29 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790740285.539079:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7800/0xc6b31a1b598e9b22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b31a1b598e9b29 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740285.539084:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790740285.539094:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7800/0xc6b31a1b598e9b22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9b29 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.539099:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790740285.539109:0:5832:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7800/0xc6b31a1b598e9b22 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9b29 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.539126:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7800/0xc6b31a1b598e9b22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9b29 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.539135:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790740285.539138:0:5832:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.158@tcp lock: ffff8f0d9f498600/0xc6b31a1b598e9af8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598e9aff expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.539144:0:5832:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f498600 already unused, calling callback (ffffffffc1baec20) 10000000:00010000:0.0:1790740285.539147:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.158@tcp lock: ffff8f0d9f498600/0xc6b31a1b598e9af8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b31a1b598e9aff expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.539154:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.158@tcp lock: ffff8f0d9f498600/0xc6b31a1b598e9af8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b31a1b598e9aff expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790740285.539162:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.158@tcp lock: ffff8f0d9f498600/0xc6b31a1b598e9af8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b31a1b598e9aff expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740285.539168:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790740285.539180:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.158@tcp lock: ffff8f0d9f498600/0xc6b31a1b598e9af8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9aff expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.539185:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790740285.539189:0:5832:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.158@tcp lock: ffff8f0d9f498600/0xc6b31a1b598e9af8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9aff expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.539195:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.158@tcp lock: ffff8f0d9f498600/0xc6b31a1b598e9af8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9aff expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.539208:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740285.539214:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740285.539217:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740285.539224:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740285.539238:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d84914380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3304:1877727158233088:0@lo:103: 00000100:00100000:0.0:1790740285.539272:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740285.539296:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d84915180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3304:1877727158233600:0@lo:103: 00000100:00100000:0.0:1790740285.539315:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740285.539333:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790740285.539338:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d84914a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3304:1877727158233472:0@lo:103: 00000100:00100000:0.0:1790740285.539355:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740285.539382:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d84914e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3305:1877727158233216:0@lo:103: 00000100:00100000:0.0:1790740285.539403:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740285.539413:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d84914000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3305:1877727158233728:0@lo:103: 00000100:00100000:0.0:1790740285.539428:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740285.539437:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1790740285.539442:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d84915880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3305:1877727158233344:0@lo:103: 00000100:00100000:0.0:1790740285.539458:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740285.539467:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d84917800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3305:1877727158233856:0@lo:103: 00000100:00100000:0.0:1790740285.539483:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740285.539505:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158233088 00000100:00100000:0.0:1790740285.539512:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158233088 00010000:00010000:0.0:1790740285.539534:0:5830:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0d9f977600/0xc6b31a1b598e9bae lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598e9ba7 expref: 19 pid: 5835 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740285.539549:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158233600 00000100:00100000:0.0:1790740285.539552:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158233600 00010000:00010000:0.0:1790740285.539562:0:5830:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0d9fea7c00/0xc6b31a1b598e9b53 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598e9b4c expref: 20 pid: 5835 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740285.539607:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158233472 00000100:00100000:0.0:1790740285.539610:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158233472 00010000:00010000:0.0:1790740285.539622:0:5830:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0d9f976c00/0xc6b31a1b598e9b61 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598e9b5a expref: 21 pid: 5836 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740285.539632:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158233216 00000100:00100000:0.0:1790740285.539634:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158233216 00010000:00010000:0.0:1790740285.539643:0:5830:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0d9fea6200/0xc6b31a1b598e9b8b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598e9b84 expref: 22 pid: 5837 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740285.539653:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158233728 00000100:00100000:0.0:1790740285.539655:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158233728 00010000:00010000:0.0:1790740285.539663:0:5830:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0d9f498200/0xc6b31a1b598e9b29 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598e9b22 expref: 23 pid: 5836 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740285.539672:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158233344 00000100:00100000:0.0:1790740285.539674:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158233344 00010000:00010000:0.0:1790740285.539681:0:5830:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0d9f977e00/0xc6b31a1b598e9b6f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598e9b68 expref: 24 pid: 5837 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740285.539689:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158233856 00000100:00100000:0.0:1790740285.539691:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158233856 00010000:00010000:0.0:1790740285.539699:0:5830:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0d9f976a00/0xc6b31a1b598e9aff lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598e9af8 expref: 25 pid: 5836 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740285.539712:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790740285.539718:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d84917480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+25:3304:x1877727158233088:12345-0@lo:103: 00010000:00010000:0.0:1790740285.539729:0:5830:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740285.539734:0:5830:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0d9f977600/0xc6b31a1b598e9bae lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598e9ba7 expref: 25 pid: 5835 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.539754:0:5830:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0d9f977600/0xc6b31a1b598e9bae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b31a1b598e9ba7 expref: 25 pid: 5835 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.539770:0:5830:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740285.539798:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d84917480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+25:3304:x1877727158233088:12345-0@lo:103: Request processed in 81us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740285.539805:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790740285.539820:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790740285.539825:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d84915500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+24:3304:x1877727158233600:12345-0@lo:103: 00010000:00010000:0.0:1790740285.539833:0:5830:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740285.539836:0:5830:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0d9fea7c00/0xc6b31a1b598e9b53 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598e9b4c expref: 24 pid: 5835 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.539844:0:5830:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0d9fea7c00/0xc6b31a1b598e9b53 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b31a1b598e9b4c expref: 24 pid: 5835 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.539852:0:5830:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740285.539871:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d84915500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+24:3304:x1877727158233600:12345-0@lo:103: Request processed in 46us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740285.539877:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790740285.539888:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790740285.539893:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8812ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+23:3304:x1877727158233472:12345-0@lo:103: 00010000:00010000:0.0:1790740285.539900:0:5830:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740285.539904:0:5830:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0d9f976c00/0xc6b31a1b598e9b61 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598e9b5a expref: 23 pid: 5836 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.539912:0:5830:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0d9f976c00/0xc6b31a1b598e9b61 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b31a1b598e9b5a expref: 23 pid: 5836 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.539926:0:5830:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740285.539945:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8812ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+23:3304:x1877727158233472:12345-0@lo:103: Request processed in 52us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740285.539951:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790740285.539965:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790740285.539970:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8812e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+22:3305:x1877727158233216:12345-0@lo:103: 00010000:00010000:0.0:1790740285.539977:0:5830:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740285.539981:0:5830:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0d9fea6200/0xc6b31a1b598e9b8b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598e9b84 expref: 22 pid: 5837 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.539989:0:5830:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0d9fea6200/0xc6b31a1b598e9b8b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b31a1b598e9b84 expref: 22 pid: 5837 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.539998:0:5830:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740285.540020:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8812e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+22:3305:x1877727158233216:12345-0@lo:103: Request processed in 50us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740285.540033:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790740285.540044:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790740285.540050:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8812d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+21:3305:x1877727158233728:12345-0@lo:103: 00010000:00010000:0.0:1790740285.540057:0:5830:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740285.540060:0:5830:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0d9f498200/0xc6b31a1b598e9b29 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598e9b22 expref: 21 pid: 5836 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.540067:0:5830:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0d9f498200/0xc6b31a1b598e9b29 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b31a1b598e9b22 expref: 21 pid: 5836 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.540076:0:5830:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740285.540104:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8812d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+21:3305:x1877727158233728:12345-0@lo:103: Request processed in 54us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740285.540121:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790740285.540139:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790740285.540146:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8812ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+20:3305:x1877727158233344:12345-0@lo:103: 00010000:00010000:0.0:1790740285.540155:0:5830:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740285.540158:0:5830:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0d9f977e00/0xc6b31a1b598e9b6f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598e9b68 expref: 20 pid: 5837 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.540165:0:5830:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0d9f977e00/0xc6b31a1b598e9b6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b31a1b598e9b68 expref: 20 pid: 5837 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.540175:0:5830:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740285.540194:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8812ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+20:3305:x1877727158233344:12345-0@lo:103: Request processed in 50us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740285.540200:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790740285.540212:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790740285.540218:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d87403050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3305:x1877727158233856:12345-0@lo:103: 00010000:00010000:0.0:1790740285.540225:0:5830:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740285.540229:0:5830:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0d9f976a00/0xc6b31a1b598e9aff lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598e9af8 expref: 19 pid: 5836 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.540236:0:5830:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0d9f976a00/0xc6b31a1b598e9aff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b31a1b598e9af8 expref: 19 pid: 5836 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.540243:0:5830:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740285.540261:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d87403050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3305:x1877727158233856:12345-0@lo:103: Request processed in 44us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740285.540266:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790740285.540327:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d84915880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3305:1877727158233344:0@lo:103: 00000100:00100000:0.0:1790740285.540336:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d84917800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3305:1877727158233856:0@lo:103: 00000100:00100000:0.0:1790740285.540343:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d84914e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3305:1877727158233216:0@lo:103: 00000100:00100000:0.0:1790740285.540349:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d84914000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3305:1877727158233728:0@lo:103: 00000100:00100000:0.0:1790740285.540372:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d84914a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3304:1877727158233472:0@lo:103: 00000100:00100000:0.0:1790740285.540378:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d84914380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3304:1877727158233088:0@lo:103: 00000100:00100000:0.0:1790740285.540384:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d84915180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3304:1877727158233600:0@lo:103: 00010000:00010000:1.0:1790740285.541010:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0d9f977600/0xc6b31a1b598e9bae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b31a1b598e9ba7 expref: 18 pid: 5835 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740285.541029:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d8498df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1877727158232192:0@lo:104: 00010000:00010000:1.0:1790740285.541040:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0d9fea6200/0xc6b31a1b598e9b8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b31a1b598e9b84 expref: 17 pid: 5837 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740285.541047:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d8498dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1877727158232320:0@lo:104: 00010000:00010000:1.0:1790740285.541058:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0d9f977e00/0xc6b31a1b598e9b6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b31a1b598e9b68 expref: 16 pid: 5837 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740285.541067:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d8498d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1877727158232448:0@lo:104: 00010000:00010000:1.0:1790740285.541076:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0d9f976c00/0xc6b31a1b598e9b61 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b31a1b598e9b5a expref: 15 pid: 5836 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740285.541086:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d8498f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1877727158232576:0@lo:104: 00010000:00010000:1.0:1790740285.541107:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0d9fea7c00/0xc6b31a1b598e9b53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b31a1b598e9b4c expref: 14 pid: 5835 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740285.541126:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a41c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1877727158232704:0@lo:104: 00010000:00010000:1.0:1790740285.541136:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0d9f498200/0xc6b31a1b598e9b29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b31a1b598e9b22 expref: 13 pid: 5836 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740285.541145:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a41500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1877727158232832:0@lo:104: 00010000:00010000:1.0:1790740285.541154:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0d9f976a00/0xc6b31a1b598e9aff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b31a1b598e9af8 expref: 12 pid: 5836 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740285.541162:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a43480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1877727158232960:0@lo:104: 00000100:00100000:1.0:1790740285.553334:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740285.553852:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133044864 00000100:00100000:0.0:1790740285.553869:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133044864 00010000:00010000:0.0:1790740285.553909:0:5830:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0d9fea7600/0xc6b31a1b598e9bca lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee2f6 expref: 10 pid: 5837 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740285.553946:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 19 00000100:00100000:0.0:1790740285.553955:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1a42d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+10:2370:x1877727133044864:12345-192.168.203.58@tcp:103: 00010000:00010000:0.0:1790740285.553970:0:5830:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740285.553975:0:5830:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0d9fea7600/0xc6b31a1b598e9bca lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee2f6 expref: 10 pid: 5837 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.553987:0:5830:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0d9fea7600/0xc6b31a1b598e9bca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee2f6 expref: 10 pid: 5837 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.554007:0:5830:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740285.554066:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1a42d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+10:2370:x1877727133044864:12345-192.168.203.58@tcp:103: Request processed in 112us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740285.554073:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 19 00010000:00010000:3.0:1790740285.554912:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0d9fea7600/0xc6b31a1b598e9bca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee2f6 expref: 9 pid: 5837 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740285.554930:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d8498f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1877727158231936:192.168.203.58@tcp:104: 00000100:00100000:3.0:1790740285.554942:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d8498c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1877727158232064:192.168.203.58@tcp:104: 00010000:00010000:3.0:1790740285.554994:0:8441:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f0d9f977000/0xc6b31a1b598e9c02 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740285.558840:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740285.559055:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133044992 00000100:00100000:0.0:1790740285.559065:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133044992 00010000:00010000:0.0:1790740285.559120:0:5829:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0d9f499800/0xc6b31a1b598e9bc3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee2ef expref: 9 pid: 5836 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740285.559157:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 20 00000100:00100000:0.0:1790740285.559167:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db6dc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+9:2370:x1877727133044992:12345-192.168.203.58@tcp:103: 00010000:00010000:0.0:1790740285.559181:0:5829:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740285.559186:0:5829:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0d9f499800/0xc6b31a1b598e9bc3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee2ef expref: 9 pid: 5836 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.559197:0:5829:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0d9f499800/0xc6b31a1b598e9bc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee2ef expref: 9 pid: 5836 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.559223:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0d9f499800/0xc6b31a1b598e9bc3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee2ef expref: 9 pid: 5836 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.559240:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f0d9f977000/0xc6b31a1b598e9c02 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.559248:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0d9f977000/0xc6b31a1b598e9c02 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.559264:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f0d9f977000/0xc6b31a1b598e9c02 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.559270:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f0d9f977000/0xc6b31a1b598e9c02 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.559277:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f0d9f977000/0xc6b31a1b598e9c02 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.559310:0:5829:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f0d9f977000/0xc6b31a1b598e9c02 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.559316:0:5829:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f977000 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:0.0:1790740285.559320:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f0d9f977000/0xc6b31a1b598e9c02 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.559328:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f0d9f977000/0xc6b31a1b598e9c02 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.559345:0:5829:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f0d9f977000/0xc6b31a1b598e9c02 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.559356:0:5829:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740285.559413:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db6dc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+8:2370:x1877727133044992:12345-192.168.203.58@tcp:103: Request processed in 247us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740285.559420:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 20 00010000:00010000:3.0:1790740285.559482:0:8441:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f0d9f977000/0xc6b31a1b598e9c02 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740285.559498:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f0d9f977000/0xc6b31a1b598e9c02 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740285.559504:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0d9f977000/0xc6b31a1b598e9c02 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740285.744716:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740286.348280:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740286.348327:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740286.348366:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740286.348397:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133045504 00000100:00100000:2.0:1790740286.348400:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740286.348406:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133045504 00000100:00080000:2.0:1790740286.348453:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790740286.348463:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133045376 00000100:00100000:1.0:1790740286.348465:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133045376 00000100:00100000:2.0:1790740286.348483:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 10 00000100:00100000:3.0:1790740286.348524:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133045120 00000100:00100000:3.0:1790740286.348529:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133045120 00000100:00100000:3.0:1790740286.348563:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 131 00000100:00100000:3.0:1790740286.348597:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d84876850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+8:2372:x1877727133045120:12345-192.168.203.58@tcp:400: 00000100:00100000:3.0:1790740286.348666:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d84876850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+8:2372:x1877727133045120:12345-192.168.203.58@tcp:400: Request processed in 96us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740286.348674:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 131 00000100:00100000:2.0:1790740286.348840:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db6dc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec599375-3198-45fd-a23a-c5620f07177c+5:2372:x1877727133045504:12345-192.168.203.58@tcp:400: 00000100:00100000:2.0:1790740286.348901:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db6dc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec599375-3198-45fd-a23a-c5620f07177c+5:2372:x1877727133045504:12345-192.168.203.58@tcp:400: Request processed in 410us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740286.349753:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133045248 00000100:00100000:0.0:1790740286.349761:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133045248 00000100:00100000:0.0:1790740286.349808:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 24 00000100:00100000:0.0:1790740286.349817:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db6dc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+6:2372:x1877727133045248:12345-192.168.203.58@tcp:400: 00000100:00100000:0.0:1790740286.349865:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db6dc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+6:2372:x1877727133045248:12345-192.168.203.58@tcp:400: Request processed in 49us (1595us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740286.349877:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 24 00000100:00100000:1.0:1790740286.349922:0:6699:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1790740286.349933:0:6699:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:0.0:1790740286.350003:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790740286.350008:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790740286.350020:0:6700:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1790740286.350036:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 11 00000100:00100000:0.0:1790740286.350043:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db6dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec599375-3198-45fd-a23a-c5620f07177c+5:2372:x1877727133045376:12345-192.168.203.58@tcp:400: 00000100:00100000:0.0:1790740286.350073:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db6dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec599375-3198-45fd-a23a-c5620f07177c+5:2372:x1877727133045376:12345-192.168.203.58@tcp:400: Request processed in 30us (1672us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740286.350079:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 11 00000100:00100000:2.0:1790740286.352216:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 10 10000000:01000000:1.0:1790740286.576718:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1790740286.576725:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f0db562c800 from 39 10000000:01000000:1.0:1790740286.576730:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790740286.576781:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976c00/0xc6b31a1b598e9c09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740286.576792:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976c00/0xc6b31a1b598e9c09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740286.576803:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976c00/0xc6b31a1b598e9c09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740286.576845:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158233984:0@lo:101: 00000100:00100000:1.0:1790740286.576914:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740286.576974:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d98019a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790740286.577058:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158233984 00000100:00100000:0.0:1790740286.577066:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158233984 00000100:00100000:0.0:1790740286.577128:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1790740286.577137:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+12:5841:x1877727158233984:12345-0@lo:101: 00010000:00010000:0.0:1790740286.577150:0:5837:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740286.577164:0:5837:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0d9fea6400/0xc6b31a1b598e9c10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b31a1b598e9c09 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740286.577187:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0d9fea6400/0xc6b31a1b598e9c10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b31a1b598e9c09 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740286.577196:0:5837:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0d9fea6400/0xc6b31a1b598e9c10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e9c09 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740286.577205:0:5837:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9fea6400, rc 0) 00000100:00100000:0.0:1790740286.577254:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+13:5841:x1877727158233984:12345-0@lo:101: Request processed in 115us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740286.577260:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1790740286.577512:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158233984:0@lo:101: 00010000:00010000:1.0:1790740286.577528:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976c00/0xc6b31a1b598e9c09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9c10 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740286.577536:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976c00/0xc6b31a1b598e9c09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598e9c10 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740286.577620:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158234112:0@lo:501: 00000100:00100000:1.0:1790740286.577647:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740286.577675:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d98019a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790740286.577724:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158234112 00000100:00100000:3.0:1790740286.577729:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158234112 00000100:00100000:3.0:1790740286.577760:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1790740286.577767:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+13:5841:x1877727158234112:12345-0@lo:501: 00000100:00100000:3.0:1790740286.578001:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+13:5841:x1877727158234112:12345-0@lo:501: Request processed in 234us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740286.578008:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1790740286.578117:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158234112:0@lo:501: 00000100:00100000:1.0:1790740286.578145:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158234240:0@lo:503: 00000100:00100000:1.0:1790740286.578179:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740286.578198:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d98019a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790740286.578247:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158234240 00000100:00100000:3.0:1790740286.578252:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158234240 00000100:00100000:3.0:1790740286.578321:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1790740286.578328:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+13:5841:x1877727158234240:12345-0@lo:503: 00000100:00100000:3.0:1790740286.578692:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+13:5841:x1877727158234240:12345-0@lo:503: Request processed in 364us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740286.578710:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1790740286.578789:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158234240:0@lo:503: 00000100:00100000:3.0:1790740286.579559:0:8461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d98512680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:8461:1877727158234368:0@lo:502: 00000100:00100000:3.0:1790740286.579632:0:8461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740286.579705:0:8461:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d87584b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790740286.583605:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158234368 00000100:00100000:0.0:1790740286.583621:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158234368 00000100:00100000:0.0:1790740286.583750:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1790740286.583760:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+13:8461:x1877727158234368:12345-0@lo:502: 00000100:00100000:0.0:1790740286.584072:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+13:8461:x1877727158234368:12345-0@lo:502: Request processed in 313us (4437us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740286.584088:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1790740286.584195:0:8461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d98512680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:8461:1877727158234368:0@lo:502: 00000100:00100000:1.0:1790740286.584261:0:8461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a42680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:8461:1877727158234496:0@lo:502: 00000100:00100000:1.0:1790740286.584309:0:8461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740286.592597:0:8461:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d98019a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790740286.592746:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158234496 00000100:00100000:3.0:1790740286.592756:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158234496 00000100:00100000:3.0:1790740286.592812:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1790740286.592823:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+13:8461:x1877727158234496:12345-0@lo:502: 00000100:00100000:3.0:1790740286.593095:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+13:8461:x1877727158234496:12345-0@lo:502: Request processed in 274us (8786us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740286.593117:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1790740286.596510:0:8461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a42680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:8461:1877727158234496:0@lo:502: 00000040:00080000:1.0:1790740286.596609:0:8461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1790740286.596726:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1790740286.596755:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790740286.596768:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976c00/0xc6b31a1b598e9c09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9c10 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740286.596780:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976c00/0xc6b31a1b598e9c09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9c10 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740286.596791:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1790740286.596794:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1790740286.596797:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1790740286.596835:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7a00/0xc6b31a1b598e9c17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740286.596844:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7a00/0xc6b31a1b598e9c17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740286.596854:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7a00/0xc6b31a1b598e9c17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740286.596876:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d8812ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158234624:0@lo:101: 00000100:00100000:0.0:1790740286.596944:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740286.597033:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d849729c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790740286.597246:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158234624 00000100:00100000:3.0:1790740286.597254:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158234624 00000100:00100000:3.0:1790740286.597300:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1790740286.597310:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+13:5841:x1877727158234624:12345-0@lo:101: 00010000:00010000:3.0:1790740286.597322:0:5835:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740286.597334:0:5835:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0d9f498c00/0xc6b31a1b598e9c1e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b31a1b598e9c17 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740286.597369:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0d9f498c00/0xc6b31a1b598e9c1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b31a1b598e9c17 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740286.597379:0:5835:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0d9f498c00/0xc6b31a1b598e9c1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e9c17 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740286.597387:0:5835:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9f498c00, rc 0) 00000100:00100000:3.0:1790740286.597437:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+14:5841:x1877727158234624:12345-0@lo:101: Request processed in 129us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740286.597452:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1790740286.597650:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d8812ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158234624:0@lo:101: 00010000:00010000:1.0:1790740286.597667:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7a00/0xc6b31a1b598e9c17 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9c1e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740286.597678:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7a00/0xc6b31a1b598e9c17 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598e9c1e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740286.597732:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158234752:0@lo:501: 00000100:00100000:1.0:1790740286.597765:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740286.597793:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d98019a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790740286.597846:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158234752 00000100:00100000:2.0:1790740286.597851:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158234752 00000100:00100000:2.0:1790740286.597885:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1790740286.597892:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+14:5841:x1877727158234752:12345-0@lo:501: 00000100:00100000:2.0:1790740286.598145:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+14:5841:x1877727158234752:12345-0@lo:501: Request processed in 253us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740286.598152:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1790740286.598219:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158234752:0@lo:501: 00000100:00100000:1.0:1790740286.598252:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158234880:0@lo:503: 00000100:00100000:1.0:1790740286.598287:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740286.598309:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d98019a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790740286.598334:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158234880 00000100:00100000:0.0:1790740286.598340:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158234880 00000100:00100000:0.0:1790740286.598382:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1790740286.598390:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+14:5841:x1877727158234880:12345-0@lo:503: 00000100:00100000:0.0:1790740286.598563:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+14:5841:x1877727158234880:12345-0@lo:503: Request processed in 173us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740286.598600:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1790740286.599451:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158234880:0@lo:503: 00000100:00100000:3.0:1790740286.599974:0:8462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d98513100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:8462:1877727158235008:0@lo:502: 00000100:00100000:3.0:1790740286.600028:0:8462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740286.600068:0:8462:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d875840c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790740286.600539:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158235008 00000100:00100000:2.0:1790740286.600546:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158235008 00000100:00100000:2.0:1790740286.600615:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1790740286.600623:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+14:8462:x1877727158235008:12345-0@lo:502: 00000100:00100000:2.0:1790740286.600830:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+14:8462:x1877727158235008:12345-0@lo:502: Request processed in 208us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740286.600838:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1790740286.601006:0:8462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d98513100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:8462:1877727158235008:0@lo:502: 00000020:01000000:3.0:1790740286.601033:0:8462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790740286.601041:0:8462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790740286.601044:0:8462:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1790740286.601048:0:8462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1790740286.601074:0:8462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d98513100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:8462:1877727158235136:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790740286.601124:0:8462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740286.601155:0:8462:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d875840c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790740286.602185:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158235136 00000100:00100000:0.0:1790740286.602194:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158235136 00000100:00100000:0.0:1790740286.602235:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1790740286.602244:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+14:8462:x1877727158235136:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790740286.602431:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+14:8462:x1877727158235136:12345-0@lo:502:llog_process_th.0 Request processed in 188us (1305us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740286.602441:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1790740286.604634:0:8462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d98513100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:8462:1877727158235136:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790740286.604682:0:8462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790740286.604692:0:8462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790740286.604694:0:8462:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1790740286.604700:0:8462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1790740286.604904:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1790740286.604929:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.158@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1790740286.604939:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7a00/0xc6b31a1b598e9c17 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9c1e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740286.604952:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7a00/0xc6b31a1b598e9c17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9c1e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790740286.604962:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1790740286.604964:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f0d83fe1000 from 39 10000000:01000000:1.0:1790740286.604967:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790740286.605009:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977e00/0xc6b31a1b598e9c25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740286.605017:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977e00/0xc6b31a1b598e9c25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740286.605027:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977e00/0xc6b31a1b598e9c25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740286.605047:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158235264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790740286.605100:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740286.605183:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d98019a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790740286.606907:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158235264 00000100:00100000:2.0:1790740286.606921:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158235264 00000100:00100000:2.0:1790740286.606986:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1790740286.606997:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+14:5841:x1877727158235264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790740286.607027:0:5836:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740286.607042:0:5836:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0dc21d2c00/0xc6b31a1b598e9c2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b31a1b598e9c25 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740286.607068:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0dc21d2c00/0xc6b31a1b598e9c2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b31a1b598e9c25 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740286.607078:0:5836:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0dc21d2c00/0xc6b31a1b598e9c2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e9c25 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740286.607086:0:5836:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0dc21d2c00, rc 0) 00000100:00100000:2.0:1790740286.607164:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+15:5841:x1877727158235264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 170us (2064us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740286.607171:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1790740286.607262:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158235264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790740286.607279:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977e00/0xc6b31a1b598e9c25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9c2c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740286.607289:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977e00/0xc6b31a1b598e9c25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598e9c2c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740286.607369:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158235392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790740286.607399:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740286.607436:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d98019a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790740286.607495:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158235392 00000100:00100000:3.0:1790740286.607500:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158235392 00000100:00100000:3.0:1790740286.607534:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1790740286.607542:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+15:5841:x1877727158235392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790740286.607797:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+15:5841:x1877727158235392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 255us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740286.607804:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1790740286.607901:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158235392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790740286.607929:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158235520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790740286.607962:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740286.607978:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d98019a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790740286.608079:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158235520 00000100:00100000:2.0:1790740286.608083:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158235520 00000100:00100000:2.0:1790740286.608099:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1790740286.608115:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+15:5841:x1877727158235520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790740286.608251:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+15:5841:x1877727158235520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 145us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740286.608258:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1790740286.608320:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158235520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790740286.608816:0:8463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a42680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:8463:1877727158235648:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790740286.608855:0:8463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740286.608884:0:8463:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d98019240 going to sleep for 11 seconds 00000100:00100000:2.0:1790740286.608924:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158235648 00000100:00100000:2.0:1790740286.608929:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158235648 00000100:00100000:2.0:1790740286.608959:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1790740286.608966:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+15:8463:x1877727158235648:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790740286.609141:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+15:8463:x1877727158235648:12345-0@lo:502:llog_process_th.0 Request processed in 175us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740286.609157:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1790740286.609262:0:8463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a42680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:8463:1877727158235648:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790740286.609302:0:8463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a42680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:8463:1877727158235776:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790740286.609330:0:8463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740286.609357:0:8463:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d98019240 going to sleep for 11 seconds 00000100:00100000:0.0:1790740286.609402:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158235776 00000100:00100000:0.0:1790740286.609407:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158235776 00000100:00100000:0.0:1790740286.609437:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1790740286.609443:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+15:8463:x1877727158235776:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790740286.609611:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+15:8463:x1877727158235776:12345-0@lo:502:llog_process_th.0 Request processed in 168us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740286.609618:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1790740286.609751:0:8463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a42680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:8463:1877727158235776:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1790740286.609771:0:8463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1790740286.609911:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1790740286.609934:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790740286.609944:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977e00/0xc6b31a1b598e9c25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9c2c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740286.609955:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977e00/0xc6b31a1b598e9c25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9c2c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740286.609974:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1790740286.609976:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1790740286.609979:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1790740286.610001:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9f498a00/0xc6b31a1b598e9c33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740286.610009:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.158@tcp lock: ffff8f0d9f498a00/0xc6b31a1b598e9c33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740286.610018:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.158@tcp lock: ffff8f0d9f498a00/0xc6b31a1b598e9c33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740286.610032:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d98513b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158235904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790740286.610059:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740286.610078:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d875846c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790740286.610146:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158235904 00000100:00100000:2.0:1790740286.610150:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158235904 00000100:00100000:2.0:1790740286.610179:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1790740286.610185:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+15:5841:x1877727158235904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790740286.610193:0:5836:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740286.610205:0:5836:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0dc21d3e00/0xc6b31a1b598e9c3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b31a1b598e9c33 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740286.610225:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0dc21d3e00/0xc6b31a1b598e9c3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b31a1b598e9c33 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740286.610235:0:5836:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0dc21d3e00/0xc6b31a1b598e9c3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e9c33 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740286.610243:0:5836:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0dc21d3e00, rc 0) 00000100:00100000:2.0:1790740286.610281:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+16:5841:x1877727158235904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740286.610288:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1790740286.610633:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d98513b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158235904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790740286.610647:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.158@tcp lock: ffff8f0d9f498a00/0xc6b31a1b598e9c33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9c3a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740286.610656:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.158@tcp lock: ffff8f0d9f498a00/0xc6b31a1b598e9c33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598e9c3a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740286.610699:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158236032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790740286.610726:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740286.610747:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d98019240 going to sleep for 11 seconds 00000100:00100000:2.0:1790740286.610820:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158236032 00000100:00100000:2.0:1790740286.610824:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158236032 00000100:00100000:2.0:1790740286.610853:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1790740286.610859:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83fec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+16:5841:x1877727158236032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790740286.611080:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83fec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+16:5841:x1877727158236032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 220us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740286.611086:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1790740286.611191:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158236032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790740286.611221:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158236160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790740286.611255:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740286.611275:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d98019240 going to sleep for 11 seconds 00000100:00100000:0.0:1790740286.611317:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158236160 00000100:00100000:0.0:1790740286.611322:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158236160 00000100:00100000:0.0:1790740286.611356:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1790740286.611363:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83fed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+16:5841:x1877727158236160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790740286.611499:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83fed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+16:5841:x1877727158236160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 136us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740286.611506:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1790740286.611775:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158236160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790740286.614796:0:8464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db6dc3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:8464:1877727158236288:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790740286.614885:0:8464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740286.614927:0:8464:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d87573900 going to sleep for 11 seconds 00000100:00100000:3.0:1790740286.615032:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158236288 00000100:00100000:3.0:1790740286.615039:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158236288 00000100:00100000:3.0:1790740286.615077:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1790740286.615086:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83fef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+16:8464:x1877727158236288:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790740286.615357:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83fef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+16:8464:x1877727158236288:12345-0@lo:502:llog_process_th.0 Request processed in 271us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740286.615365:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1790740286.618759:0:8464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db6dc3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:8464:1877727158236288:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790740286.618810:0:8464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790740286.618824:0:8464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790740286.618826:0:8464:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1790740286.618833:0:8464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1790740286.618873:0:8464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db6dc3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:8464:1877727158236416:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790740286.618947:0:8464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740286.618992:0:8464:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0db6690840 going to sleep for 11 seconds 00000100:00100000:3.0:1790740286.619055:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158236416 00000100:00100000:3.0:1790740286.619062:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158236416 00000100:00100000:3.0:1790740286.619159:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1790740286.619168:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83fed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+16:8464:x1877727158236416:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790740286.619393:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83fed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+16:8464:x1877727158236416:12345-0@lo:502:llog_process_th.0 Request processed in 225us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740286.619408:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1790740286.619479:0:8464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db6dc3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:8464:1877727158236416:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790740286.619499:0:8464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790740286.619503:0:8464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790740286.619505:0:8464:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1790740286.619509:0:8464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:1.0:1790740286.620947:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1790740286.620978:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.158@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1790740286.620988:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9f498a00/0xc6b31a1b598e9c33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9c3a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740286.620999:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.158@tcp lock: ffff8f0d9f498a00/0xc6b31a1b598e9c33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9c3a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790740286.621010:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1790740286.621012:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f0d85311800 from 39 10000000:01000000:1.0:1790740286.621014:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790740286.621048:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977600/0xc6b31a1b598e9c41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740286.621056:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977600/0xc6b31a1b598e9c41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740286.621066:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977600/0xc6b31a1b598e9c41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740286.621088:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158236544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790740286.621155:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740286.626995:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d98019e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790740286.627134:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158236544 00000100:00100000:0.0:1790740286.627145:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158236544 00000100:00100000:0.0:1790740286.627195:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1790740286.627204:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83fee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+16:5841:x1877727158236544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790740286.627235:0:5835:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740286.627253:0:5835:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0d9fea7200/0xc6b31a1b598e9c48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b31a1b598e9c41 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740286.627282:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0d9fea7200/0xc6b31a1b598e9c48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b31a1b598e9c41 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740286.627294:0:5835:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0d9fea7200/0xc6b31a1b598e9c48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e9c41 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740286.627303:0:5835:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9fea7200, rc 0) 00000100:00100000:0.0:1790740286.627380:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83fee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+17:5841:x1877727158236544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (6224us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740286.627388:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1790740286.627723:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158236544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790740286.627739:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977600/0xc6b31a1b598e9c41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9c48 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740286.627749:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977600/0xc6b31a1b598e9c41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598e9c48 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740286.627837:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158236672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790740286.627871:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740286.627888:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d98019e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790740286.627933:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158236672 00000100:00100000:0.0:1790740286.627938:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158236672 00000100:00100000:0.0:1790740286.627968:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1790740286.627976:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83fee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+17:5841:x1877727158236672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790740286.628228:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83fee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+17:5841:x1877727158236672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 253us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740286.628235:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1790740286.628303:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158236672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790740286.628344:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158236800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790740286.628384:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740286.628404:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d98019e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790740286.628505:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158236800 00000100:00100000:0.0:1790740286.628509:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158236800 00000100:00100000:0.0:1790740286.628527:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1790740286.628532:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83fef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+17:5841:x1877727158236800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790740286.628697:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83fef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+17:5841:x1877727158236800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 164us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740286.628713:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1790740286.628841:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158236800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790740286.629194:0:8465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a42680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:8465:1877727158236928:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790740286.629227:0:8465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740286.629252:0:8465:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d98019a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790740286.629291:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158236928 00000100:00100000:0.0:1790740286.629295:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158236928 00000100:00100000:0.0:1790740286.629320:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1790740286.629325:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83fefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+17:8465:x1877727158236928:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790740286.629616:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83fefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+17:8465:x1877727158236928:12345-0@lo:502:llog_process_th.0 Request processed in 290us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740286.629623:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1790740286.629781:0:8465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a42680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:8465:1877727158236928:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790740286.629822:0:8465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a42680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:8465:1877727158237056:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790740286.629851:0:8465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740286.629907:0:8465:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d98019a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790740286.630931:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158237056 00000100:00100000:3.0:1790740286.630940:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158237056 00000100:00100000:3.0:1790740286.631019:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1790740286.631028:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83feec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+17:8465:x1877727158237056:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790740286.631246:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83feec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+17:8465:x1877727158237056:12345-0@lo:502:llog_process_th.0 Request processed in 220us (1393us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740286.631253:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1790740286.631326:0:8465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a42680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:8465:1877727158237056:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1790740286.631370:0:8465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1790740286.631526:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1790740286.631544:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790740286.631554:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977600/0xc6b31a1b598e9c41 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9c48 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740286.631565:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977600/0xc6b31a1b598e9c41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9c48 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790740286.631604:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1790740286.631607:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1790740286.631611:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1790740286.631639:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3000/0xc6b31a1b598e9c4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740286.631658:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3000/0xc6b31a1b598e9c4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740286.631668:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3000/0xc6b31a1b598e9c4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740286.631686:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db6dc3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158237184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790740286.631720:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740286.639822:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0db6690840 going to sleep for 11 seconds 00000100:00100000:0.0:1790740286.641470:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158237184 00000100:00100000:0.0:1790740286.641485:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158237184 00000100:00100000:0.0:1790740286.641545:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1790740286.641556:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83fee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+17:5841:x1877727158237184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790740286.643347:0:5835:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740286.643375:0:5835:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0d9fea7800/0xc6b31a1b598e9c56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b31a1b598e9c4f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740286.643410:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0d9fea7800/0xc6b31a1b598e9c56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b31a1b598e9c4f expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740286.643423:0:5835:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0d9fea7800/0xc6b31a1b598e9c56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e9c4f expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740286.643433:0:5835:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9fea7800, rc 0) 00000100:00100000:0.0:1790740286.643584:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83fee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+18:5841:x1877727158237184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2015us (11847us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740286.643594:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1790740286.643988:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db6dc3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158237184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790740286.644008:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3000/0xc6b31a1b598e9c4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9c56 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740286.644017:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3000/0xc6b31a1b598e9c4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598e9c56 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740286.644087:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db6dc3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158237312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790740286.644136:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740286.644170:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0db6690840 going to sleep for 11 seconds 00000100:00100000:3.0:1790740286.644217:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158237312 00000100:00100000:3.0:1790740286.644223:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158237312 00000100:00100000:3.0:1790740286.644266:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1790740286.644274:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83fecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+18:5841:x1877727158237312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790740286.644524:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83fecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+18:5841:x1877727158237312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 251us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740286.644531:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1790740286.644775:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db6dc3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158237312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790740286.644804:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db6dc3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158237440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790740286.644842:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740286.644869:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0db6690840 going to sleep for 11 seconds 00000100:00100000:2.0:1790740286.644883:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158237440 00000100:00100000:2.0:1790740286.644886:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158237440 00000100:00100000:2.0:1790740286.644912:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1790740286.644917:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83fec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+18:5841:x1877727158237440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790740286.645055:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83fec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+18:5841:x1877727158237440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 137us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740286.645063:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1790740286.645145:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db6dc3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158237440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790740286.645518:0:8466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d8812e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:8466:1877727158237568:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790740286.645554:0:8466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740286.645598:0:8466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0db6f3bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1790740286.645654:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158237568 00000100:00100000:2.0:1790740286.645659:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158237568 00000100:00100000:2.0:1790740286.645677:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1790740286.645683:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83fef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+18:8466:x1877727158237568:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790740286.645838:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83fef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+18:8466:x1877727158237568:12345-0@lo:502:llog_process_th.0 Request processed in 155us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740286.645845:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1790740286.645921:0:8466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d8812e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:8466:1877727158237568:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790740286.645942:0:8466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790740286.645950:0:8466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740286.645952:0:8466:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1790740286.645959:0:8466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1790740286.645979:0:8466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d8812e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:8466:1877727158237696:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790740286.646009:0:8466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740286.646034:0:8466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0db6f3bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1790740286.646092:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158237696 00000100:00100000:3.0:1790740286.646096:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158237696 00000100:00100000:3.0:1790740286.646125:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1790740286.646131:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83fedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+18:8466:x1877727158237696:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790740286.646262:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83fedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+18:8466:x1877727158237696:12345-0@lo:502:llog_process_th.0 Request processed in 130us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740286.646268:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1790740286.646362:0:8466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d8812e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:8466:1877727158237696:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790740286.646379:0:8466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790740286.646383:0:8466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740286.646385:0:8466:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1790740286.646389:0:8466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1790740286.646602:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:3.0:1790740286.646617:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.158@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1790740286.646626:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3000/0xc6b31a1b598e9c4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9c56 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740286.646642:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3000/0xc6b31a1b598e9c4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9c56 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740286.646652:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1790740286.646654:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8f0d87f419c0 from 1 10000000:01000000:3.0:1790740286.646657:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1790740286.646681:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9f498800/0xc6b31a1b598e9c5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740286.646689:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.158@tcp lock: ffff8f0d9f498800/0xc6b31a1b598e9c5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740286.646698:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.158@tcp lock: ffff8f0d9f498800/0xc6b31a1b598e9c5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740286.646712:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d98512300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158237824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790740286.646738:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740286.646760:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d87584180 going to sleep for 11 seconds 00000100:00100000:2.0:1790740286.646830:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158237824 00000100:00100000:2.0:1790740286.646836:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158237824 00000100:00100000:2.0:1790740286.646854:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1790740286.646860:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83fed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+18:5841:x1877727158237824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790740286.646869:0:5836:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740286.646881:0:5836:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0dc21d3400/0xc6b31a1b598e9c64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b31a1b598e9c5d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740286.646899:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0dc21d3400/0xc6b31a1b598e9c64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b31a1b598e9c5d expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740286.646908:0:5836:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0dc21d3400/0xc6b31a1b598e9c64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e9c5d expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740286.646916:0:5836:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0dc21d3400, rc 0) 00000100:00100000:2.0:1790740286.646939:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83fed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:5841:x1877727158237824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 80us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740286.646950:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1790740286.647015:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d98512300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158237824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790740286.647027:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.158@tcp lock: ffff8f0d9f498800/0xc6b31a1b598e9c5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9c64 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740286.647035:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.158@tcp lock: ffff8f0d9f498800/0xc6b31a1b598e9c5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598e9c64 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740286.647074:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d98512300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158237952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790740286.647095:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740286.647129:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d87584180 going to sleep for 11 seconds 00000100:00100000:2.0:1790740286.647169:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158237952 00000100:00100000:2.0:1790740286.647172:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158237952 00000100:00100000:2.0:1790740286.647187:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1790740286.647192:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83fec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:5841:x1877727158237952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790740286.647625:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83fec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:5841:x1877727158237952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 431us (527us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790740286.647633:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1790740286.648410:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d98512300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158237952:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1790740286.648440:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.158@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1790740286.648448:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9f498800/0xc6b31a1b598e9c5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9c64 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740286.648458:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.158@tcp lock: ffff8f0d9f498800/0xc6b31a1b598e9c5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9c64 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740286.769422:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740287.794345:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740288.138678:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740288.138834:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133045632 00000100:00100000:2.0:1790740288.138844:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133045632 00000100:00100000:2.0:1790740288.138931:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 164 00000100:00100000:2.0:1790740288.138941:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+8:5611:x1877727133045632:12345-192.168.203.58@tcp:101: 00010000:00010000:2.0:1790740288.138957:0:5836:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740288.138976:0:5836:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0dc21d3200/0xc6b31a1b598e9c6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee358 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740288.139007:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0dc21d3200/0xc6b31a1b598e9c6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee358 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740288.139020:0:5836:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0dc21d3200/0xc6b31a1b598e9c6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee358 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740288.139030:0:5836:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0dc21d3200, rc 0) 00000100:00100000:2.0:1790740288.139107:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+9:5611:x1877727133045632:12345-192.168.203.58@tcp:101: Request processed in 166us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740288.139115:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 164 00000100:00100000:3.0:1790740288.143768:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740288.143865:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133045760 00000100:00100000:1.0:1790740288.143876:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133045760 00000100:00100000:1.0:1790740288.143931:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 165 00000100:00100000:1.0:1790740288.143941:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+9:5611:x1877727133045760:12345-192.168.203.58@tcp:501: 00000100:00100000:1.0:1790740288.144238:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+9:5611:x1877727133045760:12345-192.168.203.58@tcp:501: Request processed in 297us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740288.144263:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 165 00000100:00100000:1.0:1790740288.147563:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740288.147682:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133045888 00000100:00100000:0.0:1790740288.147693:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133045888 00000100:00100000:0.0:1790740288.147743:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 166 00000100:00100000:0.0:1790740288.147753:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+9:5611:x1877727133045888:12345-192.168.203.58@tcp:503: 00000100:00100000:0.0:1790740288.147967:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+9:5611:x1877727133045888:12345-192.168.203.58@tcp:503: Request processed in 214us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740288.147976:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 166 00000100:00100000:3.0:1790740288.152134:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740288.152293:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133046016 00000100:00100000:2.0:1790740288.152318:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133046016 00000100:00100000:2.0:1790740288.152369:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 167 00000100:00100000:2.0:1790740288.152379:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+9:6092:x1877727133046016:12345-192.168.203.58@tcp:502: 00000100:00100000:2.0:1790740288.152691:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+9:6092:x1877727133046016:12345-192.168.203.58@tcp:502: Request processed in 312us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740288.152700:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 167 00000100:00100000:3.0:1790740288.156752:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740288.156958:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133046144 00000100:00100000:1.0:1790740288.156969:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133046144 00000100:00100000:1.0:1790740288.157083:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 168 00000100:00100000:1.0:1790740288.157101:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+9:6092:x1877727133046144:12345-192.168.203.58@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790740288.158016:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+9:6092:x1877727133046144:12345-192.168.203.58@tcp:502:llog_process_th.0 Request processed in 919us (1269us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740288.158028:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 168 00000100:00100000:1.0:1790740288.161470:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740288.161639:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133046272 00000100:00100000:0.0:1790740288.161662:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133046272 00000100:00100000:0.0:1790740288.161717:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 169 00000100:00100000:0.0:1790740288.161726:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+9:5611:x1877727133046272:12345-192.168.203.58@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790740288.161743:0:5835:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740288.161762:0:5835:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0d9fea7600/0xc6b31a1b598e9c72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee35f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740288.161790:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0d9fea7600/0xc6b31a1b598e9c72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee35f expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740288.161801:0:5835:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0d9fea7600/0xc6b31a1b598e9c72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee35f expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740288.161810:0:5835:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9fea7600, rc 0) 00000100:00100000:0.0:1790740288.161867:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+10:5611:x1877727133046272:12345-192.168.203.58@tcp:101:ll_cfg_requeue.0 Request processed in 141us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740288.161873:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 169 00000100:00100000:3.0:1790740288.165003:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740288.165186:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133046400 00000100:00100000:1.0:1790740288.165196:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133046400 00000100:00100000:1.0:1790740288.165245:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 170 00000100:00100000:1.0:1790740288.165323:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+10:5611:x1877727133046400:12345-192.168.203.58@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790740288.165862:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+10:5611:x1877727133046400:12345-192.168.203.58@tcp:501:ll_cfg_requeue.0 Request processed in 541us (865us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790740288.165872:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 170 00010000:00010000:0.0:1790740288.816918:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740288.817129:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd03ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158238464:0@lo:400:kworker.0 00000100:00100000:3.0:1790740288.817131:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db5a69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1877727158238336:0@lo:400:kworker.0 00000100:00100000:1.0:1790740288.817193:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db5a69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877727158238208:0@lo:400:kworker.0 00000100:00100000:0.0:1790740288.817233:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db6dc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3303:1877727158238080:0@lo:400:kworker.0 00000100:00100000:2.0:1790740288.821867:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740288.821960:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158238464 00000100:00100000:2.0:1790740288.821969:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158238464 00000100:00100000:2.0:1790740288.822022:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790740288.822046:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd03fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1877727158238464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740288.822118:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd03fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1877727158238464:12345-0@lo:400:kworker.0 Request processed in 88us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740288.822125:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1790740288.822147:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790740288.822187:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dbd03ed80 x1877727158238464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740304 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740288.822201:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd03ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158238464:0@lo:400:kworker.0 00000100:00100000:3.0:1790740288.827424:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740288.827520:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158238336 00000100:00100000:1.0:1790740288.827530:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158238336 00000100:00100000:1.0:1790740288.827626:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790740288.827638:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d98512300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877727158238336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740288.827702:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d98512300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877727158238336:12345-0@lo:400:kworker.0 Request processed in 68us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740288.827725:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790740288.827773:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db5a69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1877727158238336:0@lo:400:kworker.0 00000100:00100000:2.0:1790740288.830240:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740288.830302:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd03f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158238720:0@lo:400:kworker.0 00000100:00100000:2.0:1790740288.830350:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740288.830432:0:8460:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158238720 00000100:00100000:2.0:1790740288.830439:0:8460:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158238720 00000100:00100000:2.0:1790740288.830481:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790740288.830489:0:8460:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd03e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158238720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740288.830554:0:8460:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd03e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158238720:12345-0@lo:400:kworker.0 Request processed in 66us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740288.830561:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1790740288.830639:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dbd03f100 x1877727158238720/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740304 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740288.830653:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd03f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158238720:0@lo:400:kworker.0 00000100:00100000:1.0:1790740288.830934:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158238208 00000100:00100000:1.0:1790740288.830939:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158238208 00000100:00100000:1.0:1790740288.830977:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790740288.830984:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd03ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877727158238208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740288.831023:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd03ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877727158238208:12345-0@lo:400:kworker.0 Request processed in 40us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740288.831041:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1790740288.832003:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790740288.832011:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790740288.832148:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db5a69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877727158238208:0@lo:400:kworker.0 00000100:00100000:0.0:1790740288.832372:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740288.832515:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd03e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1877727158238592:0@lo:400:kworker.0 00000100:00100000:0.0:1790740288.832543:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740288.832698:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158238592 00000100:00100000:1.0:1790740288.832706:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158238592 00000100:00100000:1.0:1790740288.832762:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790740288.832770:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8812e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877727158238592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740288.832816:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8812e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877727158238592:12345-0@lo:400:kworker.0 Request processed in 48us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740288.832823:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790740288.832903:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd03e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1877727158238592:0@lo:400:kworker.0 00000100:00080000:3.0:1790740288.832965:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790740288.833142:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158238080 00000100:00100000:2.0:1790740288.833147:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158238080 00000100:00100000:2.0:1790740288.833313:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1790740288.833321:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3303:x1877727158238080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740288.833370:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3303:x1877727158238080:12345-0@lo:400:kworker.0 Request processed in 51us (998us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740288.833386:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1790740288.833449:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db6dc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3303:1877727158238080:0@lo:400:kworker.0 00000100:00100000:1.0:1790740289.329754:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d8812d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158238848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790740289.329822:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740289.329967:0:6703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158238848 00000100:00100000:0.0:1790740289.329976:0:6703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158238848 00000100:00100000:0.0:1790740289.330026:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790740289.330035:0:6703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1a42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158238848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790740289.330092:0:6703:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790740289.330149:0:6703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1a42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158238848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740289.330156:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1790740289.330238:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0d8812d500 x1877727158238848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740305 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740289.330258:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d8812d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158238848:0@lo:13:osp-pre-1-0.0 00000020:00000080:2.0:1790740289.748535:0:8504:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe5d5a21e0 20000000:00000080:2.0:1790740289.748555:0:8504:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f0dc1a8d000 uarg=0000000000000000 20000000:01000000:2.0:1790740289.748626:0:8504:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1790740289.748631:0:8504:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1790740289.748636:0:8504:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1790740289.749276:0:8505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1790740289.749413:0:8504:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1790740289.754498:0:8504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1790740289.754560:0:8504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1790740289.754817:0:8504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1790740289.754834:0:8504:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1790740289.754856:0:8504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f0d87594200/0xc6b31a1b598e9c79 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740289.754889:0:8504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0d9fea6a00/0xc6b31a1b598e9a42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e9a3b expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740289.754896:0:8504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0dc21d2a00/0xc6b31a1b598e9ac0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e9ab9 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740289.754903:0:8504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0d9fea6800/0xc6b31a1b598e9b1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e9b14 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740289.754912:0:8504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0d9f977a00/0xc6b31a1b598e9bd8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee327 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740289.754920:0:8504:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f0d87594200/0xc6b31a1b598e9c79 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740289.754957:0:8504:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0d9f977a00/0xc6b31a1b598e9bd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee327 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740289.754972:0:8504:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f0d9f977a00/0xc6b31a1b598e9bd8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee327 expref: 9 pid: 5837 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740289.754985:0:8504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd03f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8504:1877727158238976:192.168.203.58@tcp:104: 00010000:00010000:2.0:1790740289.755269:0:8504:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0d9fea6800/0xc6b31a1b598e9b1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b31a1b598e9b14 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740289.755278:0:8504:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f0d9fea6800/0xc6b31a1b598e9b1b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b31a1b598e9b14 expref: 18 pid: 5836 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740289.755288:0:8504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd03c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8504:1877727158239104:0@lo:104: 00000100:00100000:2.0:1790740289.755335:0:8504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790740289.755379:0:8504:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0dc21d2a00/0xc6b31a1b598e9ac0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b31a1b598e9ab9 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740289.755386:0:8504:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f0dc21d2a00/0xc6b31a1b598e9ac0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b31a1b598e9ab9 expref: 18 pid: 5836 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740289.755394:0:8504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd03d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8504:1877727158239232:0@lo:104: 00000100:00100000:2.0:1790740289.755421:0:8504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790740289.755446:0:8504:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0d9fea6a00/0xc6b31a1b598e9a42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b31a1b598e9a3b expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740289.755453:0:8504:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f0d9fea6a00/0xc6b31a1b598e9a42 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b31a1b598e9a3b expref: 18 pid: 5835 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740289.755460:0:8504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd03ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8504:1877727158239360:0@lo:104: 00000100:00100000:2.0:1790740289.755477:0:8504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d85cd0240 going to sleep for 11 seconds 00000100:00100000:1.0:1790740289.755763:0:5826:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1790740289.755783:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740289.755794:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158239104 00000100:00100000:1.0:1790740289.755802:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158239104 00000100:00100000:1.0:1790740289.755846:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158239232 00000100:00100000:1.0:1790740289.755850:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158239232 00000100:00100000:1.0:1790740289.755872:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158239360 00000100:00100000:1.0:1790740289.755875:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158239360 00000100:00100000:1.0:1790740289.755888:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790740289.755896:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd03ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+5:8504:x1877727158239104:12345-0@lo:104: 00010000:00010000:1.0:1790740289.755909:0:5826:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499600/0xc6b31a1b598e9b14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598e9b1b expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740289.755965:0:5826:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790740289.755971:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd03ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+5:8504:x1877727158239104:12345-0@lo:104: Request processed in 76us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740289.755977:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790740289.755994:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790740289.755999:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1a70c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+4:8504:x1877727158239232:12345-0@lo:104: 00010000:00010000:1.0:1790740289.756007:0:5826:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977800/0xc6b31a1b598e9ab9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598e9ac0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740289.756052:0:5826:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1790740289.756057:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1a70c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+4:8504:x1877727158239232:12345-0@lo:104: Request processed in 59us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740289.756063:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790740289.756102:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790740289.756109:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1a43100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+3:8504:x1877727158239360:12345-0@lo:104: 00010000:00010000:1.0:1790740289.756116:0:5826:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3800/0xc6b31a1b598e9a3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598e9a42 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740289.756143:0:5826:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1790740289.756148:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1a43100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+3:8504:x1877727158239360:12345-0@lo:104: Request processed in 40us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740289.756163:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1790740289.756269:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1790740289.756277:0:5832:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499600/0xc6b31a1b598e9b14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598e9b1b expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740289.756287:0:5832:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f499600 already unused, calling callback (ffffffffc1baec20) 10000000:00010000:0.0:1790740289.756292:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499600/0xc6b31a1b598e9b14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b31a1b598e9b1b expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740289.756301:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499600/0xc6b31a1b598e9b14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b31a1b598e9b1b expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790740289.756308:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499600/0xc6b31a1b598e9b14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b31a1b598e9b1b expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740289.756315:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790740289.756347:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499600/0xc6b31a1b598e9b14 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9b1b expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740289.756354:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790740289.756374:0:5832:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499600/0xc6b31a1b598e9b14 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9b1b expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740289.756382:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499600/0xc6b31a1b598e9b14 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9b1b expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740289.756396:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790740289.756406:0:5832:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977800/0xc6b31a1b598e9ab9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598e9ac0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740289.756412:0:5832:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f977800 already unused, calling callback (ffffffffc1baec20) 10000000:00010000:0.0:1790740289.756415:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977800/0xc6b31a1b598e9ab9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b31a1b598e9ac0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740289.756421:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977800/0xc6b31a1b598e9ab9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b31a1b598e9ac0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790740289.756428:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977800/0xc6b31a1b598e9ab9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b31a1b598e9ac0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740289.756432:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790740289.756458:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977800/0xc6b31a1b598e9ab9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9ac0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740289.756463:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790740289.756478:0:5832:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977800/0xc6b31a1b598e9ab9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9ac0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740289.756484:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977800/0xc6b31a1b598e9ab9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9ac0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740289.756498:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790740289.756501:0:5832:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3800/0xc6b31a1b598e9a3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598e9a42 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740289.756505:0:5832:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc21d3800 already unused, calling callback (ffffffffc1baec20) 10000000:00010000:0.0:1790740289.756508:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3800/0xc6b31a1b598e9a3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b31a1b598e9a42 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740289.756524:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3800/0xc6b31a1b598e9a3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b31a1b598e9a42 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790740289.756530:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3800/0xc6b31a1b598e9a3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b31a1b598e9a42 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740289.756534:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790740289.756548:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3800/0xc6b31a1b598e9a3b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9a42 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740289.756553:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790740289.756559:0:5832:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3800/0xc6b31a1b598e9a3b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9a42 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740289.756565:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3800/0xc6b31a1b598e9a3b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9a42 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740289.756851:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740289.756853:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740289.756855:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740289.756862:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740289.756875:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d8812ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3306:1877727158239488:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790740289.756914:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740289.758502:0:8504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd03c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8504:1877727158239104:0@lo:104: 00000100:00100000:2.0:1790740289.758515:0:8504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd03d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8504:1877727158239232:0@lo:104: 00000100:00100000:2.0:1790740289.758521:0:8504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd03ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8504:1877727158239360:0@lo:104: 00000100:00100000:0.0:1790740289.758728:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d8812d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3303:1877727158239616:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790740289.758779:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740289.758818:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790740289.758824:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d8812ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3303:1877727158239744:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790740289.758841:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740289.758871:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158239488 00000100:00100000:2.0:1790740289.758880:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158239488 00000100:00100000:0.0:1790740289.758897:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158239616 00000100:00100000:0.0:1790740289.758903:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158239616 00010000:00010000:2.0:1790740289.758916:0:5829:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0d9fea6800/0xc6b31a1b598e9b1b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598e9b14 expref: 20 pid: 5836 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740289.758925:0:5828:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0dc21d2a00/0xc6b31a1b598e9ac0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598e9ab9 expref: 20 pid: 5836 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740289.758940:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158239744 00000100:00100000:2.0:1790740289.758944:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158239744 00000100:00100000:0.0:1790740289.758952:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1790740289.758957:0:5829:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0d9fea6a00/0xc6b31a1b598e9a42 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598e9a3b expref: 21 pid: 5835 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740289.758965:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d84916d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+21:3306:x1877727158239488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790740289.758983:0:5828:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790740289.758986:0:5829:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:0.0:1790740289.758991:0:5828:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0d9fea6800/0xc6b31a1b598e9b1b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598e9b14 expref: 21 pid: 5836 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740289.758994:0:5829:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1790740289.759007:0:5828:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0d9fea6800/0xc6b31a1b598e9b1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b31a1b598e9b14 expref: 21 pid: 5836 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740289.759024:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0d9fea6800/0xc6b31a1b598e9b1b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b31a1b598e9b14 expref: 21 pid: 5836 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740289.759040:0:5828:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740289.759077:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d84916d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+20:3306:x1877727158239488:12345-0@lo:103:ldlm_bl.0 Request processed in 116us (2161us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740289.759095:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790740289.759114:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790740289.759122:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d84916680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3303:x1877727158239616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790740289.759130:0:5828:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740289.759135:0:5828:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0dc21d2a00/0xc6b31a1b598e9ac0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598e9ab9 expref: 19 pid: 5836 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740289.759142:0:5828:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0dc21d2a00/0xc6b31a1b598e9ac0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b31a1b598e9ab9 expref: 19 pid: 5836 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740289.759162:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0dc21d2a00/0xc6b31a1b598e9ac0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b31a1b598e9ab9 expref: 19 pid: 5836 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740289.759172:0:5828:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740289.759208:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d84916680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+18:3303:x1877727158239616:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740289.759214:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790740289.759228:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790740289.759233:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d84917100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+17:3303:x1877727158239744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790740289.759240:0:5828:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740289.759244:0:5828:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0d9fea6a00/0xc6b31a1b598e9a42 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598e9a3b expref: 17 pid: 5835 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740289.759252:0:5828:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0d9fea6a00/0xc6b31a1b598e9a42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b31a1b598e9a3b expref: 17 pid: 5835 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740289.759261:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0d9fea6a00/0xc6b31a1b598e9a42 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b31a1b598e9a3b expref: 17 pid: 5835 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740289.759269:0:5828:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790740289.759366:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d8812d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3303:1877727158239616:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790740289.760984:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d84917100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+16:3303:x1877727158239744:12345-0@lo:103:ldlm_bl.0 Request processed in 1732us (2123us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740289.760985:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d8812ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3303:1877727158239744:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790740289.761002:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790740289.761743:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d8812ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3306:1877727158239488:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790740289.765758:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740289.765818:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133046528 00000100:00100000:1.0:1790740289.765829:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133046528 00010000:00010000:1.0:1790740289.765872:0:5830:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0d9f977a00/0xc6b31a1b598e9bd8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee327 expref: 10 pid: 5837 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740289.765918:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 24 00000100:00100000:1.0:1790740289.765928:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d84917b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+10:2370:x1877727133046528:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790740289.765943:0:5830:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740289.765949:0:5830:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0d9f977a00/0xc6b31a1b598e9bd8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee327 expref: 10 pid: 5837 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740289.765961:0:5830:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0d9f977a00/0xc6b31a1b598e9bd8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee327 expref: 10 pid: 5837 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740289.765981:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f0d87594200/0xc6b31a1b598e9c79 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740289.765989:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0d87594200/0xc6b31a1b598e9c79 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740289.766005:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f0d87594200/0xc6b31a1b598e9c79 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740289.766013:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f0d87594200/0xc6b31a1b598e9c79 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740289.766020:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f0d87594200/0xc6b31a1b598e9c79 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740289.766044:0:5830:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f0d87594200/0xc6b31a1b598e9c79 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740289.766050:0:5830:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87594200 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:1.0:1790740289.766055:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f0d87594200/0xc6b31a1b598e9c79 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740289.766063:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f0d87594200/0xc6b31a1b598e9c79 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740289.766073:0:5830:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f0d87594200/0xc6b31a1b598e9c79 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740289.766094:0:5830:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740289.766159:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d84917b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+10:2370:x1877727133046528:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 230us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740289.766168:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 24 00010000:00010000:2.0:1790740289.771415:0:8504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0d9f977a00/0xc6b31a1b598e9bd8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee327 expref: 9 pid: 5837 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740289.771443:0:8504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd03f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8504:1877727158238976:192.168.203.58@tcp:104: 00010000:00010000:2.0:1790740289.772584:0:8504:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f0d87594200/0xc6b31a1b598e9c79 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740289.772619:0:8504:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f0d87594200/0xc6b31a1b598e9c79 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740289.772628:0:8504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f0d87594200/0xc6b31a1b598e9c79 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740289.772635:0:8504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0d87594200/0xc6b31a1b598e9c79 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740289.844679:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740289.845370:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d84916300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158239872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790740289.845438:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740289.845531:0:6703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158239872 00000100:00100000:1.0:1790740289.845540:0:6703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158239872 00000100:00100000:1.0:1790740289.845622:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790740289.845632:0:6703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d98510380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158239872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790740289.845665:0:6703:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790740289.848955:0:6703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d98510380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158239872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3317us (3509us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740289.848968:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1790740289.849116:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0d84916300 x1877727158239872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740305 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740289.849156:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d84916300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158239872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790740289.954669:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740289.954779:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133046656 00000100:00100000:1.0:1790740289.954791:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133046656 00000100:00100000:1.0:1790740289.954848:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 172 00000100:00100000:1.0:1790740289.954869:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+9:5611:x1877727133046656:12345-192.168.203.58@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790740289.954887:0:5837:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740289.954907:0:5837:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0d9f976600/0xc6b31a1b598e9c80 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee366 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740289.954937:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0d9f976600/0xc6b31a1b598e9c80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee366 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740289.954949:0:5837:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0d9f976600/0xc6b31a1b598e9c80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee366 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740289.954957:0:5837:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9f976600, rc 0) 00000100:00100000:1.0:1790740289.955029:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+10:5611:x1877727133046656:12345-192.168.203.58@tcp:101:ll_cfg_requeue.0 Request processed in 163us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740289.955037:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 172 00000100:00100000:2.0:1790740289.959086:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740289.959549:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133046784 00000100:00100000:0.0:1790740289.959567:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133046784 00000100:00100000:1.0:1790740289.959682:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 173 00000100:00100000:1.0:1790740289.959695:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+10:5611:x1877727133046784:12345-192.168.203.58@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790740289.960054:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+10:5611:x1877727133046784:12345-192.168.203.58@tcp:501:ll_cfg_requeue.0 Request processed in 362us (985us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740289.960064:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 173 00000100:00100000:0.0:1790740289.962208:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740289.962240:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133046912 00000100:00100000:0.0:1790740289.962249:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133046912 00000100:00100000:0.0:1790740289.962373:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 174 00000100:00100000:0.0:1790740289.962384:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+10:5611:x1877727133046912:12345-192.168.203.58@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790740289.963204:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+10:5611:x1877727133046912:12345-192.168.203.58@tcp:503:ll_cfg_requeue.0 Request processed in 819us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740289.963213:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 174 00000100:00100000:0.0:1790740289.971649:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740289.972376:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133047040 00000100:00100000:2.0:1790740289.972389:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133047040 00000100:00100000:2.0:1790740289.972451:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 175 00000100:00100000:2.0:1790740289.972461:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+10:6128:x1877727133047040:12345-192.168.203.58@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790740289.972712:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+10:6128:x1877727133047040:12345-192.168.203.58@tcp:502:llog_process_th.0 Request processed in 252us (1071us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740289.972726:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 175 00000100:00100000:0.0:1790740289.977355:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740289.977632:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133047168 00000100:00100000:1.0:1790740289.977644:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133047168 00000100:00100000:1.0:1790740289.977707:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 176 00000100:00100000:1.0:1790740289.977717:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+10:6128:x1877727133047168:12345-192.168.203.58@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790740289.977985:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+10:6128:x1877727133047168:12345-192.168.203.58@tcp:502:llog_process_th.0 Request processed in 267us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740289.978004:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 176 00010000:00010000:2.0:1790740290.870599:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740291.469702:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740291.469828:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740291.469865:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740291.469913:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740291.469951:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133047552 00000100:00100000:1.0:1790740291.469965:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133047552 00000100:00100000:3.0:1790740291.470004:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133047424 00000100:00100000:3.0:1790740291.470012:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133047424 00000100:00100000:1.0:1790740291.470051:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133047680 00000100:00100000:1.0:1790740291.470056:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133047680 00000100:00100000:3.0:1790740291.470090:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 28 00000100:00100000:1.0:1790740291.470100:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 14 00000100:00100000:3.0:1790740291.470109:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1a42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+6:2369:x1877727133047424:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:1.0:1790740291.470115:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1a43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec599375-3198-45fd-a23a-c5620f07177c+5:2369:x1877727133047552:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:2.0:1790740291.470236:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 15 00000100:00100000:2.0:1790740291.470248:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1a40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec599375-3198-45fd-a23a-c5620f07177c+5:2369:x1877727133047680:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:0.0:1790740291.470359:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133047296 00000100:00100000:0.0:1790740291.470365:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133047296 00000100:00100000:0.0:1790740291.470401:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 177 00000100:00100000:0.0:1790740291.470409:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+10:2369:x1877727133047296:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:1.0:1790740291.470521:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1a43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec599375-3198-45fd-a23a-c5620f07177c+5:2369:x1877727133047552:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 411us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740291.470530:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 14 00000100:00100000:3.0:1790740291.474970:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1a42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+6:2369:x1877727133047424:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 4849us (5083us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740291.474970:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+10:2369:x1877727133047296:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 4541us (5263us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740291.474999:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 177 00000100:00100000:3.0:1790740291.475000:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 28 00000100:00080000:3.0:1790740291.475084:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790740291.475092:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790740291.475096:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790740291.475162:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1a40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec599375-3198-45fd-a23a-c5620f07177c+5:2369:x1877727133047680:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 4914us (5244us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740291.475174:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 15 10000000:01000000:0.0:1790740291.633096:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790740291.633103:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f0db562c800 from 4 10000000:01000000:0.0:1790740291.633108:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790740291.633157:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea6a00/0xc6b31a1b598e9c87 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740291.633170:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea6a00/0xc6b31a1b598e9c87 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740291.633182:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea6a00/0xc6b31a1b598e9c87 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740291.633222:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d84915180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158240000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790740291.633286:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740291.633354:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158240000 00000100:00100000:0.0:1790740291.633367:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0db6f3b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790740291.633370:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158240000 00000100:00100000:3.0:1790740291.633514:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1790740291.633529:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+16:5841:x1877727158240000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790740291.633549:0:5837:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740291.633608:0:5837:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0d9f498000/0xc6b31a1b598e9c8e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b31a1b598e9c87 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740291.633760:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0d9f498000/0xc6b31a1b598e9c8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b31a1b598e9c87 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740291.633775:0:5837:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0d9f498000/0xc6b31a1b598e9c8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e9c87 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740291.633785:0:5837:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9f498000, rc 0) 00000100:00100000:3.0:1790740291.633865:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+17:5841:x1877727158240000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 341us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740291.633882:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1790740291.636415:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d84915180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158240000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790740291.636445:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea6a00/0xc6b31a1b598e9c87 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9c8e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740291.636458:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea6a00/0xc6b31a1b598e9c87 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598e9c8e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740291.636780:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d84915180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158240128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790740291.636839:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740291.636891:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0db6f3b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790740291.639214:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158240128 00000100:00100000:1.0:1790740291.639233:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158240128 00000100:00100000:1.0:1790740291.639312:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1790740291.639323:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+17:5841:x1877727158240128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790740291.639754:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+17:5841:x1877727158240128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 432us (2914us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740291.639762:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1790740291.640006:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d84915180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158240128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790740291.640092:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd03f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158240256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790740291.640154:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740291.640193:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d828a7300 going to sleep for 11 seconds 00000100:00100000:2.0:1790740291.640223:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158240256 00000100:00100000:2.0:1790740291.640228:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158240256 00000100:00100000:2.0:1790740291.640274:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1790740291.640282:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d874ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+17:5841:x1877727158240256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790740291.640501:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d874ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+17:5841:x1877727158240256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 219us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740291.640510:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1790740291.640633:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd03f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158240256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790740291.640887:0:8579:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd03f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:8579:1877727158240384:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790740291.640938:0:8579:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740291.640960:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158240384 00000100:00100000:2.0:1790740291.640964:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158240384 00000100:00100000:2.0:1790740291.640996:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1790740291.641002:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d874af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+17:8579:x1877727158240384:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790740291.641175:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d874af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+17:8579:x1877727158240384:12345-0@lo:502:llog_process_th.0 Request processed in 172us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740291.641183:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1790740291.641230:0:8579:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d828a79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790740291.641245:0:8579:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd03f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:8579:1877727158240384:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790740291.641269:0:8579:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790740291.641281:0:8579:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790740291.641284:0:8579:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1790740291.641290:0:8579:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f0db562c800 00000020:00000080:2.0:1790740291.641292:0:8579:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1790740291.641383:0:8579:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd03f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:8579:1877727158240512:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790740291.641419:0:8579:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740291.641439:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158240512 00000100:00100000:2.0:1790740291.641444:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158240512 00000100:00100000:2.0:1790740291.641465:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1790740291.641472:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d874adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+17:8579:x1877727158240512:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790740291.641607:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d874adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+17:8579:x1877727158240512:12345-0@lo:502:llog_process_th.0 Request processed in 136us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740291.641615:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1790740291.641651:0:8579:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d87584180 going to sleep for 11 seconds 00000100:00100000:2.0:1790740291.641663:0:8579:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd03f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:8579:1877727158240512:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790740291.641681:0:8579:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790740291.641686:0:8579:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790740291.641687:0:8579:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1790740291.641691:0:8579:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1790740291.641759:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1790740291.641786:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790740291.641798:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea6a00/0xc6b31a1b598e9c87 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9c8e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740291.641811:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea6a00/0xc6b31a1b598e9c87 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9c8e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790740291.641824:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790740291.641827:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f0d83fe1000 from 4 10000000:01000000:2.0:1790740291.641831:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790740291.641861:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d87594000/0xc6b31a1b598e9c95 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740291.641869:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.158@tcp lock: ffff8f0d87594000/0xc6b31a1b598e9c95 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740291.641879:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.158@tcp lock: ffff8f0d87594000/0xc6b31a1b598e9c95 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740291.641893:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd03f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158240640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790740291.641927:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740291.641943:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d828a79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790740291.641957:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158240640 00000100:00100000:2.0:1790740291.641960:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158240640 00000100:00100000:2.0:1790740291.641982:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1790740291.641988:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d874ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+17:5841:x1877727158240640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790740291.641997:0:5836:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740291.642010:0:5836:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0d87594800/0xc6b31a1b598e9c9c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b31a1b598e9c95 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740291.642048:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0d87594800/0xc6b31a1b598e9c9c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b31a1b598e9c95 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740291.642061:0:5836:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0d87594800/0xc6b31a1b598e9c9c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e9c95 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740291.642082:0:5836:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d87594800, rc 0) 00000100:00100000:2.0:1790740291.642113:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d874ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+18:5841:x1877727158240640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740291.642120:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1790740291.642151:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd03f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158240640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790740291.642165:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.158@tcp lock: ffff8f0d87594000/0xc6b31a1b598e9c95 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9c9c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740291.642174:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.158@tcp lock: ffff8f0d87594000/0xc6b31a1b598e9c95 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598e9c9c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740291.642218:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd03f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158240768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790740291.642243:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740291.642256:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d828a79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790740291.642267:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158240768 00000100:00100000:2.0:1790740291.642270:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158240768 00000100:00100000:2.0:1790740291.642290:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1790740291.642295:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d874ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+18:5841:x1877727158240768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790740291.642549:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d874ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+18:5841:x1877727158240768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 253us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740291.642566:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1790740291.642631:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd03f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158240768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790740291.642660:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd03f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158240896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790740291.642697:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740291.642711:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d828a79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790740291.642723:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158240896 00000100:00100000:2.0:1790740291.642726:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158240896 00000100:00100000:2.0:1790740291.642744:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1790740291.642750:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d874ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+18:5841:x1877727158240896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790740291.642889:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d874ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+18:5841:x1877727158240896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 138us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740291.642896:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1790740291.642962:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd03f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158240896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790740291.654708:0:8580:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd03f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:8580:1877727158241024:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790740291.654827:0:8580:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740291.654878:0:8580:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d828a79c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790740291.655061:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158241024 00000100:00100000:3.0:1790740291.655082:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158241024 00000100:00100000:3.0:1790740291.655148:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1790740291.655160:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d874ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+18:8580:x1877727158241024:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790740291.655457:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d874ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+18:8580:x1877727158241024:12345-0@lo:502:llog_process_th.0 Request processed in 299us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740291.655465:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1790740291.656258:0:8580:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd03f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:8580:1877727158241024:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790740291.656326:0:8580:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790740291.656339:0:8580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790740291.656341:0:8580:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1790740291.656348:0:8580:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f0d83fe1000 00000020:00000080:2.0:1790740291.656351:0:8580:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1790740291.656444:0:8580:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd03f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:8580:1877727158241152:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790740291.656505:0:8580:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740291.656550:0:8580:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d83e11840 going to sleep for 11 seconds 00000100:00100000:3.0:1790740291.656885:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158241152 00000100:00100000:3.0:1790740291.656896:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158241152 00000100:00100000:3.0:1790740291.657026:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1790740291.657036:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d874af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+18:8580:x1877727158241152:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790740291.657304:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d874af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+18:8580:x1877727158241152:12345-0@lo:502:llog_process_th.0 Request processed in 269us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740291.657312:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1790740291.657497:0:8580:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd03f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:8580:1877727158241152:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790740291.657532:0:8580:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790740291.657539:0:8580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790740291.657542:0:8580:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1790740291.657547:0:8580:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1790740291.657907:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1790740291.657931:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790740291.658018:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d87594000/0xc6b31a1b598e9c95 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9c9c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740291.658032:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.158@tcp lock: ffff8f0d87594000/0xc6b31a1b598e9c95 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9c9c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740291.658046:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790740291.658049:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f0d85311800 from 4 10000000:01000000:3.0:1790740291.658052:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790740291.658102:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499200/0xc6b31a1b598e9ca3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740291.658122:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499200/0xc6b31a1b598e9ca3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740291.658134:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499200/0xc6b31a1b598e9ca3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740291.658159:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d98510e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158241280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790740291.658209:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740291.658241:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0db563b900 going to sleep for 11 seconds 00000100:00100000:2.0:1790740291.658762:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158241280 00000100:00100000:2.0:1790740291.658771:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158241280 00000100:00100000:2.0:1790740291.658819:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1790740291.658829:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d874ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+18:5841:x1877727158241280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790740291.658844:0:5836:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740291.658862:0:5836:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0d87595400/0xc6b31a1b598e9caa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b31a1b598e9ca3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740291.658893:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0d87595400/0xc6b31a1b598e9caa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b31a1b598e9ca3 expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740291.658905:0:5836:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0d87595400/0xc6b31a1b598e9caa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e9ca3 expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740291.658914:0:5836:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d87595400, rc 0) 00000100:00100000:2.0:1790740291.659453:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d874ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:5841:x1877727158241280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 622us (1240us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740291.659461:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1790740291.659553:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d98510e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158241280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790740291.660908:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499200/0xc6b31a1b598e9ca3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9caa expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740291.660927:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499200/0xc6b31a1b598e9ca3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598e9caa expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740291.662314:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d98510e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158241408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790740291.662410:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740291.662466:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0db563b900 going to sleep for 11 seconds 00000100:00100000:2.0:1790740291.662996:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158241408 00000100:00100000:2.0:1790740291.663007:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158241408 00000100:00100000:2.0:1790740291.663078:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1790740291.663089:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d874ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:5841:x1877727158241408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790740291.664092:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d874ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:5841:x1877727158241408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 999us (1677us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740291.664114:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1790740291.664216:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d98510e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158241408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790740291.664393:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d98510e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158241536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790740291.664442:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740291.664679:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0db563b900 going to sleep for 11 seconds 00000100:00100000:2.0:1790740291.664741:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158241536 00000100:00100000:2.0:1790740291.664749:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158241536 00000100:00100000:2.0:1790740291.664791:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1790740291.664800:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d874ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:5841:x1877727158241536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790740291.666489:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d874ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:5841:x1877727158241536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1680us (2036us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740291.666503:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1790740291.666734:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d98510e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158241536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790740291.668722:0:8583:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d98510e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:8583:1877727158241664:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790740291.668833:0:8583:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740291.668915:0:8583:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0db563bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790740291.672123:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158241664 00000100:00100000:2.0:1790740291.672143:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158241664 00000100:00100000:2.0:1790740291.672225:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1790740291.672238:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d874af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:8583:x1877727158241664:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790740291.673061:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d874af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:8583:x1877727158241664:12345-0@lo:502:llog_process_th.0 Request processed in 822us (4224us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740291.673082:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1790740291.678406:0:8583:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d98510e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:8583:1877727158241664:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790740291.678469:0:8583:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790740291.678485:0:8583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740291.678488:0:8583:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1790740291.678496:0:8583:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f0d85311800 00000020:00000080:0.0:1790740291.678500:0:8583:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1790740291.680208:0:8583:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d84914380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:8583:1877727158241792:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790740291.680307:0:8583:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740291.680354:0:8583:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0db6f3b180 going to sleep for 11 seconds 00000100:00100000:1.0:1790740291.680458:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158241792 00000100:00100000:1.0:1790740291.680468:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158241792 00000100:00100000:1.0:1790740291.680524:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1790740291.680534:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d84877850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:8583:x1877727158241792:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790740291.684325:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d84877850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:8583:x1877727158241792:12345-0@lo:502:llog_process_th.0 Request processed in 3779us (4006us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740291.684347:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1790740291.684456:0:8583:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d84914380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:8583:1877727158241792:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790740291.684500:0:8583:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790740291.684510:0:8583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740291.684513:0:8583:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1790740291.684519:0:8583:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1790740291.684936:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1790740291.685277:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790740291.685291:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499200/0xc6b31a1b598e9ca3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9caa expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740291.685305:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499200/0xc6b31a1b598e9ca3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9caa expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740291.889971:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740292.912892:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740293.938202:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740293.946188:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d98511880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3306:1877727158241920:0@lo:400:kworker.0 00000100:00100000:1.0:1790740293.946300:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740293.947078:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158241920 00000100:00100000:2.0:1790740293.947093:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158241920 00000100:00100000:2.0:1790740293.947164:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1790740293.947177:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d84877c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3306:x1877727158241920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740293.960902:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d98510000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158242304:0@lo:400:kworker.0 00000100:00100000:3.0:1790740293.960997:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740293.961079:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790740293.961086:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d98513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1877727158242432:0@lo:400:kworker.0 00000100:00100000:3.0:1790740293.961115:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740293.961153:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d98511180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1877727158242176:0@lo:400:kworker.0 00000100:00100000:3.0:1790740293.961179:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740293.961199:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1790740293.961205:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d98510a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877727158242048:0@lo:400:kworker.0 00000100:00100000:3.0:1790740293.961232:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740293.961241:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d84877c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3306:x1877727158241920:12345-0@lo:400:kworker.0 Request processed in 14064us (14939us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740293.961247:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d98510e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158242560:0@lo:400:kworker.0 00000100:00100000:2.0:1790740293.961255:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1790740293.961266:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740293.961298:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158242432 00000100:00100000:3.0:1790740293.961308:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158242432 00000100:00100000:2.0:1790740293.961342:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158242176 00000100:00100000:2.0:1790740293.961345:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158242176 00000100:00100000:2.0:1790740293.961365:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158242048 00000100:00100000:3.0:1790740293.961369:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790740293.961376:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158242048 00000100:00100000:3.0:1790740293.961380:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d98512680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877727158242176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740293.961391:0:5844:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1790740293.961398:0:5844:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1790740293.961415:0:5843:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1790740293.961422:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790740293.961428:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d98513100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877727158242432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740293.961443:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d98512680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877727158242176:12345-0@lo:400:kworker.0 Request processed in 67us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740293.961450:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790740293.961461:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d98513100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877727158242432:12345-0@lo:400:kworker.0 Request processed in 33us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740293.961462:0:5842:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1790740293.961467:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790740293.961469:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790740293.961475:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d98512a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877727158242048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740293.961506:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d98512a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877727158242048:12345-0@lo:400:kworker.0 Request processed in 31us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740293.961512:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790740293.961530:0:8460:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158242304 00000100:00100000:3.0:1790740293.961534:0:8460:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158242304 00000100:00100000:3.0:1790740293.961559:0:8460:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158242560 00000100:00100000:3.0:1790740293.961562:0:8460:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158242560 00000100:00100000:2.0:1790740293.961632:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d98513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1877727158242432:0@lo:400:kworker.0 00000100:00100000:3.0:1790740293.962724:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790740293.962737:0:8460:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d98513b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158242304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740293.962816:0:8460:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d98513b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158242304:12345-0@lo:400:kworker.0 Request processed in 83us (1820us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740293.962824:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790740293.962842:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790740293.962848:0:8460:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d98511c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158242560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740293.962878:0:8460:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d98511c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158242560:12345-0@lo:400:kworker.0 Request processed in 31us (1611us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740293.962884:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1790740293.962903:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790740293.962908:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790740293.962912:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1790740293.962957:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0d98510000 x1877727158242304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740309 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740293.962981:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d98510000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158242304:0@lo:400:kworker.0 00000100:00100000:3.0:1790740293.963035:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d98510a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877727158242048:0@lo:400:kworker.0 00010000:00080000:3.0:1790740293.963046:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0d98510e00 x1877727158242560/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740309 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740293.963068:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d98510e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158242560:0@lo:400:kworker.0 00000100:00100000:3.0:1790740293.963082:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d98511180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1877727158242176:0@lo:400:kworker.0 00000100:00100000:1.0:1790740293.963173:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d98511880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3306:1877727158241920:0@lo:400:kworker.0 00000100:00100000:0.0:1790740294.448736:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790740294.448758:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d84914a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158242688:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790740294.448824:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740294.448984:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158242688 00000100:00100000:0.0:1790740294.448993:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158242688 00000100:00100000:0.0:1790740294.449063:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790740294.449072:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d84914000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158242688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790740294.449106:0:6704:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790740294.449147:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d84914000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158242688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740294.449154:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1790740294.449190:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0d84914a80 x1877727158242688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740310 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740294.449207:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d84914a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158242688:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790740294.961543:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790740294.961565:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d84914a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158242816:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790740294.961889:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740294.962021:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158242816 00000100:00100000:3.0:1790740294.962031:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158242816 00000100:00100000:3.0:1790740294.962095:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790740294.962105:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d84914e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877727158242816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790740294.962140:0:6704:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790740294.962187:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d84914e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877727158242816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740294.962194:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1790740294.962406:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0d84914a80 x1877727158242816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740310 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740294.962426:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d84914a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158242816:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790740294.962467:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740295.988556:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790740296.512982:0:8806:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg358-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:3.0:1790740296.598468:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740296.598502:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740296.598527:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740296.598549:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740296.598597:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133047808 00000100:00100000:3.0:1790740296.598607:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133047808 00000100:00100000:3.0:1790740296.598652:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 194 00000100:00100000:3.0:1790740296.598661:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d84876c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+10:2369:x1877727133047808:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:3.0:1790740296.598740:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d84876c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+10:2369:x1877727133047808:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 81us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740296.598748:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 194 00000100:00100000:3.0:1790740296.598782:0:8460:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133048064 00000100:00100000:3.0:1790740296.598786:0:8460:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133048064 00000100:00100000:3.0:1790740296.598815:0:8460:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133048192 00000100:00100000:3.0:1790740296.598818:0:8460:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133048192 00000100:00100000:3.0:1790740296.598837:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 18 00000100:00100000:3.0:1790740296.598843:0:8460:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d98511180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec599375-3198-45fd-a23a-c5620f07177c+5:2369:x1877727133048064:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:3.0:1790740296.598871:0:8460:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d98511180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec599375-3198-45fd-a23a-c5620f07177c+5:2369:x1877727133048064:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 28us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740296.598877:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 18 00000100:00100000:3.0:1790740296.598888:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 19 00000100:00100000:3.0:1790740296.598894:0:8460:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d98510a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec599375-3198-45fd-a23a-c5620f07177c+5:2369:x1877727133048192:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:3.0:1790740296.598914:0:8460:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d98510a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec599375-3198-45fd-a23a-c5620f07177c+5:2369:x1877727133048192:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 21us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740296.598920:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 19 00000100:00100000:3.0:1790740296.598934:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133047936 00000100:00100000:3.0:1790740296.598937:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133047936 00000100:00100000:3.0:1790740296.598959:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 32 00000100:00100000:3.0:1790740296.598965:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d98510e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+6:2369:x1877727133047936:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:3.0:1790740296.598988:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d98510e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+6:2369:x1877727133047936:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 23us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740296.598993:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 32 00000100:00080000:3.0:1790740296.599097:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790740296.599108:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790740296.599110:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790740297.009924:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740298.033659:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740299.057356:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3306:1877727158242944:0@lo:400:kworker.0 00000100:00100000:0.0:1790740299.057516:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740299.057599:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158243328:0@lo:400:kworker.0 00000100:00100000:0.0:1790740299.057619:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1877727158243456:0@lo:400:kworker.0 00000100:00100000:1.0:1790740299.057645:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740299.057663:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740299.057692:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877727158243072:0@lo:400:kworker.0 00000100:00100000:1.0:1790740299.057725:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790740299.057729:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740299.057744:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1877727158243200:0@lo:400:kworker.0 00000100:00100000:1.0:1790740299.057751:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158243584:0@lo:400:kworker.0 00000100:00100000:0.0:1790740299.057794:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740299.057795:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740299.057852:0:8460:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158243328 00000100:00100000:0.0:1790740299.057853:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158243456 00000100:00100000:1.0:1790740299.057863:0:8460:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158243328 00000100:00100000:0.0:1790740299.057869:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158243456 00000100:00100000:2.0:1790740299.057958:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158242944 00000100:00100000:2.0:1790740299.057963:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158242944 00000100:00100000:0.0:1790740299.058002:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158243072 00000100:00100000:0.0:1790740299.058007:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158243072 00000100:00100000:2.0:1790740299.058009:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1790740299.058037:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d84876850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3306:x1877727158242944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740299.058055:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158243200 00000100:00100000:0.0:1790740299.058059:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158243200 00000100:00100000:2.0:1790740299.058350:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d84876850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3306:x1877727158242944:12345-0@lo:400:kworker.0 Request processed in 316us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740299.058359:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1790740299.058398:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790740299.058406:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d84914a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877727158243456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740299.059986:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d84914a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877727158243456:12345-0@lo:400:kworker.0 Request processed in 1569us (2312us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740299.060002:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790740299.060067:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790740299.060083:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1a41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877727158243072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740299.060181:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1a41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877727158243072:12345-0@lo:400:kworker.0 Request processed in 106us (2455us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740299.060216:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790740299.060301:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1877727158243456:0@lo:400:kworker.0 00000100:00100000:2.0:1790740299.060317:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3306:1877727158242944:0@lo:400:kworker.0 00000100:00100000:0.0:1790740299.062150:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790740299.062167:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d84917800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877727158243200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740299.062298:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d84917800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877727158243200:12345-0@lo:400:kworker.0 Request processed in 136us (4508us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740299.062306:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1790740299.062336:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790740299.062344:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790740299.064442:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1877727158243200:0@lo:400:kworker.0 00000100:00100000:0.0:1790740299.065356:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158243584 00000100:00100000:0.0:1790740299.065368:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158243584 00000100:00100000:0.0:1790740299.065478:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790740299.065488:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1a42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158243584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740299.065670:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1a42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158243584:12345-0@lo:400:kworker.0 Request processed in 183us (7879us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740299.065678:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790740299.065734:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877727158243072:0@lo:400:kworker.0 00010000:00080000:0.0:1790740299.065751:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dc1a43800 x1877727158243584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740315 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740299.065762:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158243584:0@lo:400:kworker.0 00000100:00100000:1.0:1790740299.066163:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790740299.066175:0:8460:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1a40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158243328:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1790740299.066298:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dc1a41180 x1877727158243328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740315 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740299.066310:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158243328:0@lo:400:kworker.0 00000100:00100000:1.0:1790740299.066317:0:8460:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1a40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158243328:12345-0@lo:400:kworker.0 Request processed in 144us (8671us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740299.066326:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1790740299.066589:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790740299.576092:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790740299.576125:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd03f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158243712:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790740299.576233:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740299.576325:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158243712 00000100:00100000:2.0:1790740299.576347:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158243712 00000100:00100000:2.0:1790740299.576521:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790740299.576535:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd03ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158243712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790740299.576615:0:6704:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790740299.576676:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd03ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158243712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 145us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740299.576685:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1790740299.576744:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dbd03f100 x1877727158243712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740315 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740299.576767:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd03f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158243712:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790740300.081524:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd03f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158243840:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790740300.081642:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740300.081737:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158243840 00000100:00100000:2.0:1790740300.081747:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158243840 00000100:00100000:2.0:1790740300.081812:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790740300.081822:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd03d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158243840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790740300.081873:0:6704:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790740300.081933:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd03d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158243840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740300.081941:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1790740300.081993:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dbd03f100 x1877727158243840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740316 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740300.082028:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd03f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158243840:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1790740300.087769:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740301.107872:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790740301.388957:0:9050:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg358-server.virtnet: executing yml_node 00000100:00100000:3.0:1790740301.710918:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740301.710956:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740301.710986:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133048320 00000100:00100000:3.0:1790740301.711004:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133048320 00000100:00100000:3.0:1790740301.711053:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 196 00000100:00100000:3.0:1790740301.711063:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+10:2371:x1877727133048320:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:3.0:1790740301.711131:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+10:2371:x1877727133048320:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 69us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740301.711139:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 196 00000100:00100000:2.0:1790740301.712458:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133048448 00000100:00100000:2.0:1790740301.712467:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133048448 00000100:00100000:2.0:1790740301.712527:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 36 00000100:00100000:2.0:1790740301.712536:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d98510000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+6:2371:x1877727133048448:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:2.0:1790740301.712611:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d98510000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+6:2371:x1877727133048448:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 77us (1654us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740301.712619:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 36 00000100:00080000:2.0:1790740301.712640:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790740301.714673:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740301.714702:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740301.714729:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133048576 00000100:00100000:2.0:1790740301.714736:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133048576 00000100:00100000:2.0:1790740301.714784:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133048704 00000100:00100000:2.0:1790740301.714787:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133048704 00000100:00100000:2.0:1790740301.714812:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 10 00000100:00100000:2.0:1790740301.714821:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd03f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec599375-3198-45fd-a23a-c5620f07177c+5:2368:x1877727133048576:12345-192.168.203.58@tcp:9:kworker.0 00000020:00000080:2.0:1790740301.714852:0:6699:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc6b31a1b598e9be6 00000100:00080000:2.0:1790740301.714861:0:6699:0:(import.c:65:import_set_state_nolock()) ffff8f0db6f4f000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790740301.714899:0:6699:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1790740301.715210:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd03f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec599375-3198-45fd-a23a-c5620f07177c+2:2368:x1877727133048576:12345-192.168.203.58@tcp:9:kworker.0 Request processed in 389us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740301.715226:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 10 00000100:00100000:2.0:1790740301.715252:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 11 00000100:00100000:2.0:1790740301.715260:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd03c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec599375-3198-45fd-a23a-c5620f07177c+5:2368:x1877727133048704:12345-192.168.203.58@tcp:9:kworker.0 00000020:00000080:2.0:1790740301.715274:0:6699:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc6b31a1b598e9bed 00000100:00080000:2.0:1790740301.715280:0:6699:0:(import.c:65:import_set_state_nolock()) ffff8f0db6f49800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790740301.715299:0:6699:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1790740301.715504:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd03c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec599375-3198-45fd-a23a-c5620f07177c+2:2368:x1877727133048704:12345-192.168.203.58@tcp:9:kworker.0 Request processed in 244us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740301.715512:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 11 00000100:00080000:2.0:1790740301.715532:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790740301.715536:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790740301.715614:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740301.715620:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740302.130648:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740303.152828:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740304.177011:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740304.177068:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877727158244096:0@lo:400:kworker.0 00000100:00100000:0.0:1790740304.177149:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740304.177219:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158244608:0@lo:400:kworker.0 00000100:00100000:3.0:1790740304.177255:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158244352:0@lo:400:kworker.0 00000100:00100000:0.0:1790740304.177257:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740304.177292:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790740304.177298:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740304.177302:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1877727158244224:0@lo:400:kworker.0 00000100:00100000:3.0:1790740304.177329:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1790740304.177334:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740304.177340:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3305:1877727158243968:0@lo:400:kworker.0 00000100:00100000:0.0:1790740304.177370:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158244608 00000100:00100000:3.0:1790740304.177376:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740304.177379:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158244608 00000100:00100000:3.0:1790740304.177406:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1877727158244480:0@lo:400:kworker.0 00000100:00100000:3.0:1790740304.177432:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740304.177435:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158244352 00000100:00100000:0.0:1790740304.177439:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158244352 00000100:00100000:0.0:1790740304.177466:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790740304.177477:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790740304.177478:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d84917480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158244608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740304.177493:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d98510700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158244352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740304.177540:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d84917480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158244608:12345-0@lo:400:kworker.0 Request processed in 66us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740304.177548:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d98510700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158244352:12345-0@lo:400:kworker.0 Request processed in 60us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740304.177550:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790740304.177611:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158244096 00000100:00100000:0.0:1790740304.177616:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158244096 00000100:00100000:3.0:1790740304.177625:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790740304.177639:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158244224 00000100:00100000:0.0:1790740304.177642:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158244224 00000100:00100000:0.0:1790740304.177653:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158244480 00000100:00100000:0.0:1790740304.177655:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158244480 00000100:00100000:3.0:1790740304.177670:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158243968 00000100:00100000:0.0:1790740304.177676:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790740304.177682:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d84915880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877727158244096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740304.177692:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158243968 00000100:00100000:0.0:1790740304.177713:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d84915880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877727158244096:12345-0@lo:400:kworker.0 Request processed in 31us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740304.177729:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790740304.177742:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790740304.177748:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d84915500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1877727158244224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740304.177764:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1790740304.177775:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3305:x1877727158243968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740304.177778:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d84915500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1877727158244224:12345-0@lo:400:kworker.0 Request processed in 29us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740304.177787:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790740304.177798:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790740304.177804:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d98511500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877727158244480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740304.177824:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3305:x1877727158243968:12345-0@lo:400:kworker.0 Request processed in 51us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740304.177833:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1790740304.177838:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d98511500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877727158244480:12345-0@lo:400:kworker.0 Request processed in 34us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740304.177846:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1790740304.177865:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790740304.177870:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790740304.177872:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790740304.177893:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3305:1877727158243968:0@lo:400:kworker.0 00000100:00100000:3.0:1790740304.177908:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1877727158244480:0@lo:400:kworker.0 00010000:00080000:3.0:1790740304.177924:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dc1a40a80 x1877727158244352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740320 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740304.177935:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158244352:0@lo:400:kworker.0 00000100:00100000:0.0:1790740304.177942:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1877727158244224:0@lo:400:kworker.0 00010000:00080000:0.0:1790740304.177961:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dc1a40000 x1877727158244608/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740320 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740304.177970:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158244608:0@lo:400:kworker.0 00000100:00100000:0.0:1790740304.177993:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877727158244096:0@lo:400:kworker.0 00000100:00100000:3.0:1790740304.689868:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd03d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158244736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790740304.689942:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740304.690035:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158244736 00000100:00100000:3.0:1790740304.690044:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158244736 00000100:00100000:3.0:1790740304.690099:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790740304.690110:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d98511880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158244736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790740304.690146:0:6704:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790740304.690190:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d98511880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158244736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740304.690197:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1790740304.690242:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dbd03d180 x1877727158244736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740320 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740304.690281:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd03d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158244736:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1790740304.748472:0:6725:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ec599375-3198-45fd-a23a-c5620f07177c 00000020:00000080:3.0:1790740304.748481:0:6725:0:(genops.c:885:class_export_put()) final put ffff8f0db6f4b000/ec599375-3198-45fd-a23a-c5620f07177c 00000020:00000080:0.0:1790740304.748548:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f0db6f4b000/ec599375-3198-45fd-a23a-c5620f07177c for lustre-OST0000 00000020:00000080:0.0:1790740304.748620:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f0db6f4f000 for lustre-OST0000 00000100:00100000:2.0:1790740305.200712:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790740305.200736:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd03c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158244864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790740305.200803:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740305.200857:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158244864 00000100:00100000:3.0:1790740305.200866:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158244864 00000100:00100000:3.0:1790740305.200962:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790740305.200985:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd03f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877727158244864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790740305.201020:0:6704:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790740305.201070:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd03f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877727158244864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740305.201077:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1790740305.201267:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dbd03c000 x1877727158244864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740321 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740305.201285:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd03c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158244864:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790740305.203316:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790740305.502223:0:9243:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.59.3 00000001:00100000:2.0:1790740305.793946:0:7642:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ec599375-3198-45fd-a23a-c5620f07177c 00000020:00000080:2.0:1790740305.793956:0:7642:0:(genops.c:885:class_export_put()) final put ffff8f0db6f49000/ec599375-3198-45fd-a23a-c5620f07177c 00000020:00000080:0.0:1790740305.796083:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f0db6f49000/ec599375-3198-45fd-a23a-c5620f07177c for lustre-OST0001 00000020:00000080:0.0:1790740305.796170:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f0db6f49800 for lustre-OST0001 00010000:00010000:2.0:1790740306.226288:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740306.832855:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740306.832895:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740306.832924:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133048832 00000100:00100000:3.0:1790740306.832933:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133048832 00000100:00100000:3.0:1790740306.832995:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 198 00000100:00100000:3.0:1790740306.833006:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+10:2369:x1877727133048832:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:3.0:1790740306.833076:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+10:2369:x1877727133048832:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 72us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740306.833085:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 198 00000100:00100000:3.0:1790740306.833127:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133048960 00000100:00100000:3.0:1790740306.833131:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133048960 00000100:00100000:3.0:1790740306.833173:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 40 00000100:00100000:3.0:1790740306.833182:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d98513800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+6:2369:x1877727133048960:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:3.0:1790740306.833218:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d98513800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+6:2369:x1877727133048960:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 37us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740306.833231:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 40 00000100:00080000:3.0:1790740306.833358:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1790740307.249512:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740308.274302:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790740308.366848:0:9341:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.59.3 00010000:00010000:1.0:1790740309.296809:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740309.296847:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd03c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877727158245120:0@lo:400:kworker.0 00000100:00100000:2.0:1790740309.296917:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740309.296982:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd03d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158245632:0@lo:400:kworker.0 00000100:00100000:2.0:1790740309.297009:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740309.297045:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790740309.297051:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd03df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1877727158245248:0@lo:400:kworker.0 00000100:00100000:2.0:1790740309.297074:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740309.297102:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158245632 00000100:00100000:2.0:1790740309.297109:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158245632 00000100:00100000:2.0:1790740309.297156:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790740309.297165:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd03d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158245632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740309.297213:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd03d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158245632:12345-0@lo:400:kworker.0 Request processed in 49us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740309.297220:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790740309.297240:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158245120 00000100:00100000:2.0:1790740309.297243:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158245120 00000100:00100000:2.0:1790740309.297267:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158245248 00000100:00100000:2.0:1790740309.297270:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158245248 00000100:00100000:3.0:1790740309.297417:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd03c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3306:1877727158244992:0@lo:400:kworker.0 00000100:00100000:3.0:1790740309.297451:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740309.297473:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd03dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1877727158245504:0@lo:400:kworker.0 00000100:00100000:3.0:1790740309.297503:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740309.297520:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790740309.297525:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd03ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158245376:0@lo:400:kworker.0 00000100:00100000:3.0:1790740309.297543:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790740309.297568:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790740309.297592:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790740309.297601:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158245376 00000100:00100000:3.0:1790740309.297605:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158245376 00000100:00100000:3.0:1790740309.297631:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790740309.297706:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1c3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1877727158245376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740309.297743:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1c3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1877727158245376:12345-0@lo:400:kworker.0 Request processed in 106us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740309.297750:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790740309.297771:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158245504 00000100:00100000:3.0:1790740309.297774:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158245504 00000100:00100000:3.0:1790740309.297791:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790740309.297798:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd03f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877727158245120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740309.297885:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd03f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877727158245120:12345-0@lo:400:kworker.0 Request processed in 87us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740309.297892:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790740309.297905:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790740309.297917:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1c3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877727158245504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740309.297955:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1c3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877727158245504:12345-0@lo:400:kworker.0 Request processed in 39us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740309.297961:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790740309.297979:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158244992 00000100:00100000:3.0:1790740309.297983:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158244992 00000100:00100000:3.0:1790740309.298004:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1790740309.298010:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3306:x1877727158244992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740309.298036:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3306:x1877727158244992:12345-0@lo:400:kworker.0 Request processed in 26us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740309.298041:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00080000:3.0:1790740309.298071:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790740309.298074:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790740309.298096:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dbd03ea00 x1877727158245376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740325 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740309.298109:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd03ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158245376:0@lo:400:kworker.0 00000100:00100000:3.0:1790740309.298117:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd03c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3306:1877727158244992:0@lo:400:kworker.0 00000100:00100000:3.0:1790740309.298126:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd03dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1877727158245504:0@lo:400:kworker.0 00000100:00100000:3.0:1790740309.298166:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd03c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877727158245120:0@lo:400:kworker.0 00010000:00080000:3.0:1790740309.298176:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dbd03d500 x1877727158245632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740325 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740309.298184:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd03d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158245632:0@lo:400:kworker.0 00000100:00100000:2.0:1790740309.298770:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790740309.298780:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd03ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1877727158245248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740309.298928:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd03ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1877727158245248:12345-0@lo:400:kworker.0 Request processed in 150us (1852us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740309.298934:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790740309.298993:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd03df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1877727158245248:0@lo:400:kworker.0 00000100:00100000:3.0:1790740309.810538:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d84914380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158245760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790740309.810634:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740309.810830:0:6703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158245760 00000100:00100000:1.0:1790740309.810840:0:6703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158245760 00000100:00100000:1.0:1790740309.810894:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790740309.810904:0:6703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158245760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790740309.810952:0:6703:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790740309.811004:0:6703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158245760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740309.811012:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1790740309.811419:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0d84914380 x1877727158245760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740325 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740309.811440:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d84914380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158245760:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790740310.321663:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740310.322028:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158245888:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790740310.322094:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740310.322252:0:6703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158245888 00000100:00100000:1.0:1790740310.322261:0:6703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158245888 00000100:00100000:1.0:1790740310.322352:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790740310.322370:0:6703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd03e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158245888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790740310.322405:0:6703:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790740310.322453:0:6703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd03e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158245888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740310.322460:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1790740310.327347:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dc1a43480 x1877727158245888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740326 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740310.327439:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158245888:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1790740310.826911:0:9439:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.59.3 00010000:00010000:1.0:1790740311.346455:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740311.950385:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740311.950428:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740311.951131:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133049216 00000100:00100000:1.0:1790740311.951142:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133049216 00000100:00100000:1.0:1790740311.951225:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 44 00000100:00100000:1.0:1790740311.951235:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1c3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+6:2371:x1877727133049216:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:1.0:1790740311.951298:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1c3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+6:2371:x1877727133049216:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 66us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740311.951305:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 44 00000100:00080000:3.0:1790740311.951440:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790740311.953049:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133049088 00000100:00100000:0.0:1790740311.953059:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133049088 00000100:00100000:0.0:1790740311.953114:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 200 00000100:00100000:0.0:1790740311.953123:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+10:2371:x1877727133049088:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:0.0:1790740311.953191:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+10:2371:x1877727133049088:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 70us (2816us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740311.953198:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 200 00010000:00010000:0.0:1790740312.369278:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790740312.521338:0:9487:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Tue Sep 29 23:51:51 EDT 2026 00010000:00010000:0.0:1790740313.393005:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740314.417733:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd03dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158246400:0@lo:400:kworker.0 00000100:00100000:2.0:1790740314.417799:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740314.417846:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1790740314.417852:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd03df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3305:1877727158246016:0@lo:400:kworker.0 00000100:00100000:2.0:1790740314.417878:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740314.417899:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd03c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1877727158246528:0@lo:400:kworker.0 00000100:00100000:2.0:1790740314.417936:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740314.417963:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158246400 00000100:00100000:2.0:1790740314.417970:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158246400 00000100:00100000:2.0:1790740314.418018:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790740314.418027:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8812ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158246400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740314.418089:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8812ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158246400:12345-0@lo:400:kworker.0 Request processed in 63us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740314.418096:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1790740314.418135:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dbd03dc00 x1877727158246400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740330 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740314.418149:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd03dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158246400:0@lo:400:kworker.0 00010000:00010000:0.0:1790740314.418450:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740314.418745:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd03d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877727158246144:0@lo:400:kworker.0 00000100:00100000:0.0:1790740314.418780:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158246016 00000100:00100000:3.0:1790740314.418782:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740314.418787:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158246016 00000100:00100000:0.0:1790740314.419093:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1790740314.419102:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3305:x1877727158246016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740314.419148:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3305:x1877727158246016:12345-0@lo:400:kworker.0 Request processed in 47us (1267us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740314.419154:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1790740314.419185:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd03c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1877727158246272:0@lo:400:kworker.0 00000100:00100000:3.0:1790740314.419296:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd03ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158246656:0@lo:400:kworker.0 00000100:00100000:3.0:1790740314.419333:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740314.419417:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd03df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3305:1877727158246016:0@lo:400:kworker.0 00000100:00100000:1.0:1790740314.419490:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740314.419650:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158246528 00000100:00100000:2.0:1790740314.419655:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158246528 00000100:00100000:2.0:1790740314.419724:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158246144 00000100:00100000:2.0:1790740314.419727:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158246144 00000100:00100000:3.0:1790740314.419842:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158246272 00000100:00100000:3.0:1790740314.419846:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158246272 00000100:00100000:0.0:1790740314.419872:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790740314.419881:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8812ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877727158246528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740314.419938:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8812ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877727158246528:12345-0@lo:400:kworker.0 Request processed in 58us (2001us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740314.419954:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790740314.419971:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790740314.419977:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1c3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877727158246144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740314.420012:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1c3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877727158246144:12345-0@lo:400:kworker.0 Request processed in 35us (1230us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740314.420018:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790740314.420162:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790740314.420171:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1a41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877727158246272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740314.420212:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1a41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877727158246272:12345-0@lo:400:kworker.0 Request processed in 43us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740314.420218:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790740314.420269:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd03c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1877727158246528:0@lo:400:kworker.0 00000100:00100000:1.0:1790740314.420273:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd03c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1877727158246272:0@lo:400:kworker.0 00000100:00080000:3.0:1790740314.423635:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790740314.423646:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790740314.423664:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158246656 00000100:00100000:3.0:1790740314.423676:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158246656 00000100:00100000:3.0:1790740314.423742:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790740314.423755:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158246656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740314.423841:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158246656:12345-0@lo:400:kworker.0 Request processed in 91us (4517us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740314.423849:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1790740314.424202:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790740314.424254:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd03d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877727158246144:0@lo:400:kworker.0 00010000:00080000:3.0:1790740314.424270:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dbd03ea00 x1877727158246656/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740330 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740314.424279:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd03ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158246656:0@lo:400:kworker.0 00000100:00100000:2.0:1790740314.928889:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d8812d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158246784:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790740314.928972:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740314.929064:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158246784 00000100:00100000:2.0:1790740314.929071:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158246784 00000100:00100000:2.0:1790740314.929123:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790740314.929155:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd03ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158246784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790740314.929202:0:6704:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790740314.929267:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd03ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158246784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740314.929274:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1790740314.929313:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0d8812d500 x1877727158246784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740330 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740314.929329:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d8812d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158246784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790740315.446355:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790740315.446379:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158246912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790740315.446446:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740315.446680:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158246912 00000100:00100000:2.0:1790740315.446689:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158246912 00000100:00100000:2.0:1790740315.446732:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790740315.446742:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1a43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877727158246912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790740315.446776:0:6704:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790740315.446824:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1a43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877727158246912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740315.446831:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1790740315.446868:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dc1a41c00 x1877727158246912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740331 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740315.446885:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158246912:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790740315.449590:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740316.468468:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740317.068782:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740317.068831:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740317.068974:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133049472 00000100:00100000:0.0:1790740317.068985:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133049472 00000100:00100000:0.0:1790740317.069051:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 48 00000100:00100000:0.0:1790740317.069063:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1c3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+6:2370:x1877727133049472:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:0.0:1790740317.069133:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1c3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+6:2370:x1877727133049472:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 73us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740317.069141:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 48 00000100:00080000:3.0:1790740317.069290:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790740317.069651:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133049344 00000100:00100000:1.0:1790740317.069657:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133049344 00000100:00100000:1.0:1790740317.069684:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 202 00000100:00100000:1.0:1790740317.069691:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+10:2369:x1877727133049344:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:1.0:1790740317.069727:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+10:2369:x1877727133049344:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 37us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740317.069734:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 202 00010000:00010000:0.0:1790740317.489083:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740318.513771:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740319.538662:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877727158247168:0@lo:400:kworker.0 00000100:00100000:1.0:1790740319.538739:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740319.538840:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158247424:0@lo:400:kworker.0 00000100:00100000:3.0:1790740319.538885:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740319.538944:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1790740319.538950:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3305:1877727158247040:0@lo:400:kworker.0 00000100:00100000:3.0:1790740319.538981:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740319.539004:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1877727158247552:0@lo:400:kworker.0 00000100:00100000:3.0:1790740319.539033:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158247424 00000100:00100000:3.0:1790740319.539040:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158247424 00000100:00100000:3.0:1790740319.539092:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790740319.539102:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158247424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740319.539151:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158247424:12345-0@lo:400:kworker.0 Request processed in 52us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740319.539158:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790740319.539183:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158247040 00000100:00100000:3.0:1790740319.539186:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158247040 00000100:00100000:3.0:1790740319.539229:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1790740319.539235:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3305:x1877727158247040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740319.539264:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3305:x1877727158247040:12345-0@lo:400:kworker.0 Request processed in 29us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740319.539281:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00080000:3.0:1790740319.539308:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790740319.539340:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740319.539350:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1877727158247296:0@lo:400:kworker.0 00000100:00100000:1.0:1790740319.539660:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158247168 00000100:00100000:1.0:1790740319.539665:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158247168 00000100:00100000:1.0:1790740319.539694:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790740319.539701:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1a41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877727158247168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740319.544404:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740319.544489:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158247296 00000100:00100000:3.0:1790740319.544499:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158247296 00000100:00100000:3.0:1790740319.544551:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790740319.544562:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1c3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877727158247296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740319.544657:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1c3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877727158247296:12345-0@lo:400:kworker.0 Request processed in 97us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740319.544664:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1790740319.544692:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790740319.544864:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1877727158247296:0@lo:400:kworker.0 00000100:00100000:1.0:1790740319.548406:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1a41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877727158247168:12345-0@lo:400:kworker.0 Request processed in 8695us (9666us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740319.548434:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790740319.549073:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877727158247168:0@lo:400:kworker.0 00000100:00100000:2.0:1790740319.549089:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158247680:0@lo:400:kworker.0 00000100:00100000:2.0:1790740319.549146:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740319.549855:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158247680 00000100:00100000:1.0:1790740319.549863:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158247680 00000100:00100000:1.0:1790740319.549941:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790740319.549951:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd03d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158247680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740319.550010:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd03d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158247680:12345-0@lo:400:kworker.0 Request processed in 61us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740319.550017:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1790740319.550072:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1790740319.550099:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dc1a41180 x1877727158247680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740319.550118:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158247680:0@lo:400:kworker.0 00000100:00100000:0.0:1790740319.550540:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740319.550649:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158247552 00000100:00100000:2.0:1790740319.550654:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158247552 00000100:00100000:2.0:1790740319.550700:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790740319.550707:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d84915180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877727158247552:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1790740319.550902:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1790740319.550944:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dc1a40a80 x1877727158247424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740319.550955:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158247424:0@lo:400:kworker.0 00000100:00100000:3.0:1790740319.550973:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3305:1877727158247040:0@lo:400:kworker.0 00000100:00100000:2.0:1790740319.551030:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d84915180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877727158247552:12345-0@lo:400:kworker.0 Request processed in 323us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740319.551037:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1790740319.551097:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1877727158247552:0@lo:400:kworker.0 00000100:00100000:2.0:1790740320.060036:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790740320.060069:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1c3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158247808:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790740320.060171:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740320.063092:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158247808 00000100:00100000:3.0:1790740320.063114:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158247808 00000100:00100000:3.0:1790740320.063257:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790740320.063271:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd03c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158247808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790740320.063334:0:6704:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790740320.063448:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd03c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158247808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 180us (3277us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740320.063470:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1790740320.064005:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dc1c3c000 x1877727158247808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740336 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740320.064033:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1c3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158247808:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790740320.562949:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790740320.562982:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd03c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158247936:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790740320.563073:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740320.563159:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158247936 00000100:00100000:2.0:1790740320.563169:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158247936 00000100:00100000:2.0:1790740320.563223:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790740320.563233:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd03df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877727158247936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790740320.563277:0:6704:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790740320.563330:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd03df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877727158247936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740320.563360:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1790740320.563415:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dbd03c000 x1877727158247936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740336 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740320.563455:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd03c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158247936:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790740320.564031:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740321.590847:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740322.202343:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740322.202420:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740322.202462:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133049600 00000100:00100000:2.0:1790740322.202474:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133049600 00000100:00100000:2.0:1790740322.202536:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 204 00000100:00100000:2.0:1790740322.202547:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+10:2372:x1877727133049600:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:2.0:1790740322.202676:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+10:2372:x1877727133049600:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 122us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740322.202685:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 204 00000100:00100000:0.0:1790740322.202887:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133049728 00000100:00100000:0.0:1790740322.202892:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133049728 00000100:00100000:0.0:1790740322.202952:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 52 00000100:00100000:0.0:1790740322.202961:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd03c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+6:2372:x1877727133049728:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:0.0:1790740322.202999:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd03c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+6:2372:x1877727133049728:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 39us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740322.203029:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 52 00000100:00080000:2.0:1790740322.203791:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790740322.613609:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740323.636141:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740324.656957:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740324.657216:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790740324.657242:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1c3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3305:1877727158248064:0@lo:400:kworker.0 00000100:00100000:3.0:1790740324.657882:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740324.658726:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158248064 00000100:00100000:1.0:1790740324.658737:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158248064 00000100:00100000:1.0:1790740324.658799:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1790740324.658809:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3305:x1877727158248064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740324.658896:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3305:x1877727158248064:12345-0@lo:400:kworker.0 Request processed in 88us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740324.658903:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1790740324.658962:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1c3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3305:1877727158248064:0@lo:400:kworker.0 00000100:00100000:3.0:1790740324.659473:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1c3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877727158248192:0@lo:400:kworker.0 00000100:00100000:3.0:1790740324.659531:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740324.659613:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790740324.659986:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158248192 00000100:00100000:3.0:1790740324.660447:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1c3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1877727158248320:0@lo:400:kworker.0 00000100:00100000:3.0:1790740324.660494:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740324.660552:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158248320 00000100:00100000:3.0:1790740324.660559:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158248320 00000100:00100000:1.0:1790740324.660718:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158248192 00000100:00100000:3.0:1790740324.660786:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790740324.660799:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1877727158248320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740324.660877:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1877727158248320:12345-0@lo:400:kworker.0 Request processed in 83us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740324.660885:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1790740324.662880:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1790740324.662898:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1c3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877727158248192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740324.663013:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1c3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877727158248192:12345-0@lo:400:kworker.0 Request processed in 121us (3480us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740324.663021:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1790740324.663245:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790740324.663496:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1c3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1877727158248320:0@lo:400:kworker.0 00000100:00100000:3.0:1790740324.663602:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1c3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877727158248192:0@lo:400:kworker.0 00000100:00100000:1.0:1790740324.663803:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1c3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158248448:0@lo:400:kworker.0 00000100:00100000:1.0:1790740324.663873:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740324.663968:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790740324.663975:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1c3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1877727158248576:0@lo:400:kworker.0 00000100:00100000:1.0:1790740324.664017:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740324.664171:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158248448 00000100:00100000:1.0:1790740324.664180:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158248448 00000100:00100000:1.0:1790740324.664235:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790740324.664245:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1a40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158248448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740324.664309:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1a40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158248448:12345-0@lo:400:kworker.0 Request processed in 65us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740324.664316:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790740324.664339:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158248576 00000100:00100000:1.0:1790740324.664342:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158248576 00000100:00100000:1.0:1790740324.664607:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790740324.664626:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1a43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877727158248576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740324.664663:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1a43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877727158248576:12345-0@lo:400:kworker.0 Request processed in 49us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740324.664670:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790740324.664707:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1c3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1877727158248576:0@lo:400:kworker.0 00010000:00080000:1.0:1790740324.664721:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dc1c3c700 x1877727158248448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740324.664731:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1c3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158248448:0@lo:400:kworker.0 00000100:00080000:3.0:1790740324.664978:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790740324.664983:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790740324.665212:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1c3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158248704:0@lo:400:kworker.0 00000100:00100000:1.0:1790740324.665687:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740324.665750:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158248704 00000100:00100000:1.0:1790740324.665756:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158248704 00000100:00100000:1.0:1790740324.665797:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790740324.665804:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1a40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158248704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740324.665861:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1a40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158248704:12345-0@lo:400:kworker.0 Request processed in 57us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740324.665867:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1790740324.665891:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1790740324.665915:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dc1c3d500 x1877727158248704/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740324.665928:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1c3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158248704:0@lo:400:kworker.0 00000100:00100000:3.0:1790740325.169378:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790740325.169406:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1c3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158248832:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790740325.169496:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740325.169597:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158248832 00000100:00100000:3.0:1790740325.169615:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158248832 00000100:00100000:3.0:1790740325.169675:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790740325.169686:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158248832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790740325.169733:0:6704:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790740325.169786:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158248832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740325.169794:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1790740325.169861:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dc1c3f480 x1877727158248832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740341 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740325.169882:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1c3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158248832:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790740325.680799:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740325.680890:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790740325.680919:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd03dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158248960:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790740325.681013:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740325.681097:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158248960 00000100:00100000:2.0:1790740325.681107:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158248960 00000100:00100000:2.0:1790740325.681179:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790740325.681190:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8812d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877727158248960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790740325.681248:0:6704:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790740325.681303:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8812d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877727158248960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740325.681311:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1790740325.681488:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dbd03dc00 x1877727158248960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740341 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740325.681510:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd03dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158248960:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790740326.704678:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740327.312340:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740327.312393:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740327.312497:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133049984 00000100:00100000:0.0:1790740327.312510:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133049984 00000100:00100000:0.0:1790740327.312616:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 56 00000100:00100000:0.0:1790740327.312627:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd03dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+6:2371:x1877727133049984:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:0.0:1790740327.312697:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd03dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+6:2371:x1877727133049984:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 72us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740327.312705:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 56 00000100:00100000:3.0:1790740327.312891:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133049856 00000100:00100000:3.0:1790740327.312897:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133049856 00000100:00100000:3.0:1790740327.312947:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 206 00000100:00100000:3.0:1790740327.312957:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+10:2371:x1877727133049856:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:3.0:1790740327.313046:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+10:2371:x1877727133049856:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 90us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740327.313054:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 206 00000100:00080000:1.0:1790740327.313160:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790740327.730477:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740328.767460:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790740329.349637:0:10117:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 23:52:07 (1790740327) === 00010000:00010000:1.0:1790740329.776875:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740329.777650:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d9018ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1877727158249344:0@lo:400:kworker.0 00000100:00100000:2.0:1790740329.777760:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740329.777860:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1790740329.777867:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d9018d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877727158249216:0@lo:400:kworker.0 00000100:00100000:2.0:1790740329.777895:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740329.777912:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d9018f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158249728:0@lo:400:kworker.0 00000100:00100000:2.0:1790740329.777938:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740329.777979:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158249344 00000100:00100000:2.0:1790740329.778003:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158249344 00000100:00100000:2.0:1790740329.778061:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158249216 00000100:00100000:2.0:1790740329.778064:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158249216 00000100:00100000:2.0:1790740329.778089:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790740329.778100:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d9018c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877727158249344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740329.778165:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d9018c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877727158249344:12345-0@lo:400:kworker.0 Request processed in 67us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740329.778174:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790740329.778193:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790740329.778200:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d9018df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877727158249216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740329.778227:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d9018df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877727158249216:12345-0@lo:400:kworker.0 Request processed in 28us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740329.778233:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790740329.778286:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d9018d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877727158249216:0@lo:400:kworker.0 00000100:00100000:2.0:1790740329.778296:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d9018ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1877727158249344:0@lo:400:kworker.0 00000100:00100000:1.0:1790740329.778504:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d9018d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158249472:0@lo:400:kworker.0 00000100:00100000:1.0:1790740329.778542:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740329.778599:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1790740329.778606:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d9018ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3305:1877727158249088:0@lo:400:kworker.0 00000100:00100000:1.0:1790740329.778637:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740329.778664:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d9018c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1877727158249600:0@lo:400:kworker.0 00000100:00100000:1.0:1790740329.778702:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740329.778729:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158249600 00000100:00100000:1.0:1790740329.778733:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158249600 00000100:00100000:1.0:1790740329.778766:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1790740329.778781:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1a40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877727158249600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740329.778830:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1a40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877727158249600:12345-0@lo:400:kworker.0 Request processed in 50us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740329.778837:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1790740329.778859:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158249728 00000100:00100000:1.0:1790740329.778863:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158249728 00000100:00100000:1.0:1790740329.778888:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158249472 00000100:00100000:1.0:1790740329.778890:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158249472 00000100:00100000:1.0:1790740329.778909:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790740329.778915:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d9018ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158249728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740329.778950:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d9018ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158249728:12345-0@lo:400:kworker.0 Request processed in 35us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740329.778955:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790740329.778966:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790740329.778971:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1a41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158249472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740329.778993:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1a41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158249472:12345-0@lo:400:kworker.0 Request processed in 23us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740329.778999:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1790740329.779014:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790740329.779018:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790740329.779021:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790740329.779031:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158249088 00000100:00100000:1.0:1790740329.779034:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158249088 00000100:00100000:1.0:1790740329.779055:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1790740329.779062:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3305:x1877727158249088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740329.779090:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3305:x1877727158249088:12345-0@lo:400:kworker.0 Request processed in 28us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740329.779105:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1790740329.779157:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d9018ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3305:1877727158249088:0@lo:400:kworker.0 00000100:00100000:1.0:1790740329.779168:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d9018c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1877727158249600:0@lo:400:kworker.0 00010000:00080000:1.0:1790740329.779182:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0d9018d180 x1877727158249472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740329.779192:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d9018d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158249472:0@lo:400:kworker.0 00010000:00080000:2.0:1790740329.780970:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0d9018f800 x1877727158249728/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740329.780989:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d9018f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158249728:0@lo:400:kworker.0 00000100:00100000:2.0:1790740329.925729:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740329.925925:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133050112 00000100:00100000:0.0:1790740329.925939:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133050112 00000100:00100000:0.0:1790740329.926011:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 208 00000100:00100000:0.0:1790740329.926022:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+10:8134:x1877727133050112:12345-192.168.203.58@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790740329.926046:0:5836:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740329.926079:0:5836:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0d9fea7c00/0xc6b31a1b598e9cb1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee36d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740329.926118:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0d9fea7c00/0xc6b31a1b598e9cb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee36d expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740329.926132:0:5836:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0d9fea7c00/0xc6b31a1b598e9cb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee36d expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740329.926142:0:5836:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9fea7c00, rc 0) 00000100:00100000:0.0:1790740329.926216:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+11:8134:x1877727133050112:12345-192.168.203.58@tcp:101:mount.lustre.0 Request processed in 196us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740329.926245:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 208 00000100:00100000:2.0:1790740329.932950:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740329.935384:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133050240 00000100:00100000:3.0:1790740329.935406:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133050240 00000100:00100000:3.0:1790740329.935512:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 209 00000100:00100000:3.0:1790740329.935526:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+11:8134:x1877727133050240:12345-192.168.203.58@tcp:501:mount.lustre.0 00000100:00100000:3.0:1790740329.935996:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+11:8134:x1877727133050240:12345-192.168.203.58@tcp:501:mount.lustre.0 Request processed in 473us (3060us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740329.936006:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 209 00000100:00100000:2.0:1790740329.954779:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740329.955318:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133050368 00000100:00100000:1.0:1790740329.955332:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133050368 00000100:00100000:1.0:1790740329.955414:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 210 00000100:00100000:1.0:1790740329.955426:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+11:8134:x1877727133050368:12345-192.168.203.58@tcp:503:mount.lustre.0 00000100:00100000:1.0:1790740329.955799:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+11:8134:x1877727133050368:12345-192.168.203.58@tcp:503:mount.lustre.0 Request processed in 366us (1026us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740329.955809:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 210 00000100:00100000:2.0:1790740329.970821:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740329.970962:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133050496 00000100:00100000:0.0:1790740329.970976:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133050496 00000100:00100000:0.0:1790740329.971049:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 211 00000100:00100000:0.0:1790740329.971061:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+11:8138:x1877727133050496:12345-192.168.203.58@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790740329.971439:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+11:8138:x1877727133050496:12345-192.168.203.58@tcp:502:llog_process_th.0 Request processed in 379us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740329.971449:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 211 00000100:00100000:2.0:1790740330.006427:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740330.007803:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133050624 00000100:00100000:3.0:1790740330.007842:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133050624 00000100:00100000:3.0:1790740330.008029:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 212 00000100:00100000:3.0:1790740330.008042:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83fec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+11:8138:x1877727133050624:12345-192.168.203.58@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790740330.009671:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83fec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+11:8138:x1877727133050624:12345-192.168.203.58@tcp:502:llog_process_th.0 Request processed in 1619us (3246us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740330.009685:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 212 00000100:00100000:2.0:1790740330.022431:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740330.023440:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133050752 00000100:00100000:1.0:1790740330.023454:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133050752 00000100:00100000:1.0:1790740330.023542:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 213 00000100:00100000:1.0:1790740330.023564:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83fed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+11:8134:x1877727133050752:12345-192.168.203.58@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790740330.023621:0:5835:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740330.023647:0:5835:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0d9f977c00/0xc6b31a1b598e9cb8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee397 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740330.023686:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0d9f977c00/0xc6b31a1b598e9cb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee397 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740330.023724:0:5835:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0d9f977c00/0xc6b31a1b598e9cb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee397 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740330.023735:0:5835:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9f977c00, rc 0) 00000100:00100000:1.0:1790740330.023825:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83fed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+12:8134:x1877727133050752:12345-192.168.203.58@tcp:101:mount.lustre.0 Request processed in 264us (1407us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740330.023834:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 213 00000100:00100000:2.0:1790740330.041057:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740330.041200:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133050880 00000100:00100000:3.0:1790740330.041214:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133050880 00000100:00100000:3.0:1790740330.041285:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 214 00000100:00100000:3.0:1790740330.041297:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83fef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+12:8134:x1877727133050880:12345-192.168.203.58@tcp:256:mount.lustre.0 20000000:01000000:3.0:1790740330.041346:0:5837:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1790740330.041379:0:5837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1790740330.041385:0:5837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1790740330.041388:0:5837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1790740330.041391:0:5837:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1790740330.044014:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83fef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+12:8134:x1877727133050880:12345-192.168.203.58@tcp:256:mount.lustre.0 Request processed in 2702us (2956us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740330.044032:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 214 00000100:00100000:2.0:1790740330.053068:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740330.055555:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133051008 00000100:00100000:0.0:1790740330.055644:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133051008 00000100:00100000:0.0:1790740330.055733:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 215 00000100:00100000:0.0:1790740330.055747:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83fed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+12:8134:x1877727133051008:12345-192.168.203.58@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790740330.055771:0:5836:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740330.055807:0:5836:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0d9fea6800/0xc6b31a1b598e9cbf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee39e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740330.055850:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0d9fea6800/0xc6b31a1b598e9cbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee39e expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740330.055865:0:5836:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0d9fea6800/0xc6b31a1b598e9cbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee39e expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740330.055877:0:5836:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9fea6800, rc 0) 00000100:00100000:0.0:1790740330.055968:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83fed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:8134:x1877727133051008:12345-192.168.203.58@tcp:101:mount.lustre.0 Request processed in 224us (2914us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740330.055976:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 215 00000100:00100000:2.0:1790740330.066489:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740330.067414:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133051136 00000100:00100000:3.0:1790740330.067428:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133051136 00000100:00100000:3.0:1790740330.067501:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 216 00000100:00100000:3.0:1790740330.067513:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83fee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:8134:x1877727133051136:12345-192.168.203.58@tcp:501:mount.lustre.0 00000100:00100000:3.0:1790740330.069789:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83fee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:8134:x1877727133051136:12345-192.168.203.58@tcp:501:mount.lustre.0 Request processed in 2267us (3295us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740330.069813:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 216 00000100:00100000:2.0:1790740330.089075:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740330.089196:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133051264 00000100:00100000:1.0:1790740330.089220:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133051264 00000100:00100000:1.0:1790740330.089297:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 217 00000100:00100000:1.0:1790740330.089309:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83fee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:8134:x1877727133051264:12345-192.168.203.58@tcp:503:mount.lustre.0 00000100:00100000:1.0:1790740330.089673:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83fee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:8134:x1877727133051264:12345-192.168.203.58@tcp:503:mount.lustre.0 Request processed in 365us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740330.089685:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 217 00000100:00100000:2.0:1790740330.097476:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740330.097745:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133051392 00000100:00100000:3.0:1790740330.097778:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133051392 00000100:00100000:3.0:1790740330.097867:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 218 00000100:00100000:3.0:1790740330.097877:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83fef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:8140:x1877727133051392:12345-192.168.203.58@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790740330.098189:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83fef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:8140:x1877727133051392:12345-192.168.203.58@tcp:502:llog_process_th.0 Request processed in 312us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740330.098199:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 218 00000100:00100000:2.0:1790740330.112738:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740330.112912:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133051520 00000100:00100000:0.0:1790740330.112928:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133051520 00000100:00100000:0.0:1790740330.113006:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 219 00000100:00100000:0.0:1790740330.113019:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83fefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:8140:x1877727133051520:12345-192.168.203.58@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790740330.113382:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83fefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:8140:x1877727133051520:12345-192.168.203.58@tcp:502:llog_process_th.0 Request processed in 365us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740330.113391:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 219 00000100:00100000:2.0:1790740330.136041:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740330.136188:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740330.140162:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133051904 00000100:00100000:3.0:1790740330.140188:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133051904 00000100:00100000:3.0:1790740330.140313:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 60 00000100:00100000:3.0:1790740330.140340:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d9018f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+6:2371:x1877727133051904:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:3.0:1790740330.140801:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d9018f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+6:2371:x1877727133051904:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 131us (4265us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740330.140810:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 60 00000100:00100000:3.0:1790740330.141365:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740330.141556:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133051648 00000100:00100000:3.0:1790740330.141567:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133051648 00000100:00100000:3.0:1790740330.141630:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 10 00000100:00100000:3.0:1790740330.141637:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1c3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2368:x1877727133051648:12345-192.168.203.58@tcp:38:mount.lustre.0 00010000:00080000:3.0:1790740330.141673:0:5842:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from e4b31cba-b68c-42cd-8636-ffe05cdf5b69@192.168.203.58@tcp t0 exp 0000000000000000 cur 246 last 0 00000020:00000080:3.0:1790740330.141724:0:5842:0:(genops.c:1384:class_connect()) connect: client e4b31cba-b68c-42cd-8636-ffe05cdf5b69, cookie 0xc6b31a1b598e9cc6 00000004:00100000:3.0:1790740330.141767:0:5842:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1790740330.142134:0:5842:0:(import.c:65:import_set_state_nolock()) ffff8f0d83f21000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790740330.142210:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1c3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+6:2368:x1877727133051648:12345-192.168.203.58@tcp:38:mount.lustre.0 Request processed in 572us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740330.142219:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 10 00000100:00080000:0.0:1790740330.142322:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790740330.158394:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133051776 00000100:00100000:1.0:1790740330.158417:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133051776 00000100:00100000:0.0:1790740330.159261:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 220 00000100:00100000:0.0:1790740330.159278:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83feec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:2371:x1877727133051776:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:0.0:1790740330.159397:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83feec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:2371:x1877727133051776:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 124us (23370us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740330.159407:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 220 00000100:00100000:2.0:1790740330.160326:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740330.160367:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740330.160555:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133052160 00000100:00100000:1.0:1790740330.160565:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133052160 00000100:00100000:1.0:1790740330.160766:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133052032 00000100:00100000:1.0:1790740330.160770:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133052032 00000100:00080000:0.0:1790740330.160813:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790740330.160936:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 11 00000100:00100000:2.0:1790740330.160949:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d9018ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+7:8134:x1877727133052160:12345-192.168.203.58@tcp:41:mount.lustre.0 00000004:00000024:2.0:1790740330.161030:0:8666:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1790740330.161143:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d9018ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+7:8134:x1877727133052160:12345-192.168.203.58@tcp:41:mount.lustre.0 Request processed in 198us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740330.161170:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 11 00000100:00100000:2.0:1790740330.161192:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 12 00000100:00100000:2.0:1790740330.161199:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d9018d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+6:0:x1877727133052032:12345-192.168.203.58@tcp:41:mount.lustre.0 00000004:00000024:2.0:1790740330.161210:0:8666:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1790740330.161234:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d9018d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+6:0:x1877727133052032:12345-192.168.203.58@tcp:41:mount.lustre.0 Request processed in 36us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740330.161242:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 12 00000100:00100000:2.0:1790740330.180661:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740330.180841:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133052288 00000100:00100000:3.0:1790740330.180854:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133052288 00000100:00100000:2.0:1790740330.180995:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 13 00000100:00100000:2.0:1790740330.181009:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d9018dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+6:8134:x1877727133052288:12345-192.168.203.58@tcp:40:mount.lustre.0 00000100:00100000:2.0:1790740330.181144:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d9018dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+6:8134:x1877727133052288:12345-192.168.203.58@tcp:40:mount.lustre.0 Request processed in 138us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740330.181152:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 13 00000100:00100000:0.0:1790740330.184238:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740330.184990:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740330.185034:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740330.185121:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133052416 00000100:00100000:0.0:1790740330.185134:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133052416 00000100:00100000:0.0:1790740330.185186:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133052544 00000100:00100000:0.0:1790740330.185190:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133052544 00000100:00100000:0.0:1790740330.185225:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 12 00000100:00100000:0.0:1790740330.185235:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1c3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2368:x1877727133052416:12345-192.168.203.58@tcp:8:mount.lustre.0 00010000:00080000:0.0:1790740330.185277:0:6699:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from e4b31cba-b68c-42cd-8636-ffe05cdf5b69@192.168.203.58@tcp t0 exp 0000000000000000 cur 246 last 0 00000020:00000080:0.0:1790740330.185328:0:6699:0:(genops.c:1384:class_connect()) connect: client e4b31cba-b68c-42cd-8636-ffe05cdf5b69, cookie 0xc6b31a1b598e9ccd 00002000:00100000:0.0:1790740330.185345:0:6699:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e4b31cba-b68c-42cd-8636-ffe05cdf5b69/ffff8f0db6f48000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790740330.185377:0:6699:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790740330.185737:0:6699:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1790740330.185776:0:6699:0:(import.c:65:import_set_state_nolock()) ffff8f0db6f4b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790740330.185869:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1c3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+6:2368:x1877727133052416:12345-192.168.203.58@tcp:8:mount.lustre.0 Request processed in 633us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740330.185879:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 12 00000100:00100000:0.0:1790740330.185903:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 13 00000100:00100000:0.0:1790740330.185907:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1c3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2368:x1877727133052544:12345-192.168.203.58@tcp:8:mount.lustre.0 00010000:00080000:0.0:1790740330.185924:0:6699:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from e4b31cba-b68c-42cd-8636-ffe05cdf5b69@192.168.203.58@tcp t0 exp 0000000000000000 cur 246 last 0 00000020:00000080:0.0:1790740330.185944:0:6699:0:(genops.c:1384:class_connect()) connect: client e4b31cba-b68c-42cd-8636-ffe05cdf5b69, cookie 0xc6b31a1b598e9cd4 00002000:00100000:0.0:1790740330.185950:0:6699:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e4b31cba-b68c-42cd-8636-ffe05cdf5b69/ffff8f0db6f4f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790740330.185967:0:6699:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:2.0:1790740330.186033:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133052672 00000100:00100000:2.0:1790740330.186040:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133052672 00000100:00100000:2.0:1790740330.186089:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 1 00000100:00100000:2.0:1790740330.186098:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d84916300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+6:8134:x1877727133052672:12345-192.168.203.58@tcp:33:mount.lustre.0 00002000:00080000:0.0:1790740330.186127:0:6699:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1790740330.186145:0:6699:0:(import.c:65:import_set_state_nolock()) ffff8f0db6f4d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790740330.186171:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1c3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+6:2368:x1877727133052544:12345-192.168.203.58@tcp:8:mount.lustre.0 Request processed in 261us (1136us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740330.186178:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 13 00000004:00200000:2.0:1790740330.186406:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1790740330.186459:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d84916300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+6:8134:x1877727133052672:12345-192.168.203.58@tcp:33:mount.lustre.0 Request processed in 363us (2238us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740330.186466:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 1 00000100:00100000:2.0:1790740330.288967:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1c3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158249856:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790740330.290313:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740330.290432:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158249856 00000100:00100000:3.0:1790740330.290447:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158249856 00000100:00100000:2.0:1790740330.291663:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790740330.291678:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d9018d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158249856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790740330.291713:0:6704:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790740330.291815:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d9018d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158249856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 141us (1509us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740330.291824:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1790740330.291881:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dc1c3ea00 x1877727158249856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740346 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740330.291904:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1c3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158249856:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1790740330.427755:0:6725:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e4b31cba-b68c-42cd-8636-ffe05cdf5b69 00000100:00100000:2.0:1790740330.805479:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158249984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790740330.805596:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790740330.805756:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740330.809268:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158249984 00000100:00100000:1.0:1790740330.809290:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158249984 00000100:00100000:1.0:1790740330.809387:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790740330.809399:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d9018f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158249984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790740330.809433:0:6704:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790740330.809560:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d9018f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158249984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 162us (3963us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740330.809618:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1790740330.809893:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dc1a41880 x1877727158249984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740346 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740330.809918:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158249984:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1790740331.408636:0:7642:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e4b31cba-b68c-42cd-8636-ffe05cdf5b69 00010000:00010000:2.0:1790740331.826738:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1790740331.923160:0:5865:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e4b31cba-b68c-42cd-8636-ffe05cdf5b69 00010000:00010000:2.0:1790740332.849564:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740333.892997:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740334.902470:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db6dc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877727158250240:0@lo:400:kworker.0 00000100:00100000:1.0:1790740334.902560:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740334.902647:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158250752:0@lo:400:kworker.0 00000100:00100000:1.0:1790740334.902672:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740334.902705:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790740334.902710:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db5a69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1877727158250368:0@lo:400:kworker.0 00000100:00100000:1.0:1790740334.902729:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740334.902767:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158250752 00000100:00100000:1.0:1790740334.902777:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158250752 00000100:00100000:1.0:1790740334.902839:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790740334.902848:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1a3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158250752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740334.902916:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1a3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158250752:12345-0@lo:400:kworker.0 Request processed in 69us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740334.902925:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1790740334.902947:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1790740334.902980:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dc1a3c000 x1877727158250752/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740334.902996:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158250752:0@lo:400:kworker.0 00000100:00100000:3.0:1790740334.903342:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db5a69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158250496:0@lo:400:kworker.0 00000100:00100000:3.0:1790740334.903385:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740334.903409:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1790740334.903415:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3305:1877727158250112:0@lo:400:kworker.0 00000100:00100000:3.0:1790740334.903445:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740334.903464:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1877727158250624:0@lo:400:kworker.0 00000100:00100000:3.0:1790740334.903501:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740334.903525:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158250496 00000100:00100000:3.0:1790740334.903529:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158250496 00000100:00100000:3.0:1790740334.903561:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790740334.903570:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1c3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158250496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740334.903621:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1c3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158250496:12345-0@lo:400:kworker.0 Request processed in 54us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740334.903628:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790740334.903649:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158250112 00000100:00100000:3.0:1790740334.903652:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158250112 00000100:00100000:3.0:1790740334.903674:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1790740334.903680:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83fee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3305:x1877727158250112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740334.903705:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83fee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3305:x1877727158250112:12345-0@lo:400:kworker.0 Request processed in 26us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740334.903717:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00080000:3.0:1790740334.903749:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790740334.903779:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3305:1877727158250112:0@lo:400:kworker.0 00010000:00080000:3.0:1790740334.903790:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0db5a69500 x1877727158250496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740334.903800:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db5a69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158250496:0@lo:400:kworker.0 00000100:00100000:1.0:1790740334.904321:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158250240 00000100:00100000:1.0:1790740334.904327:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158250240 00000100:00100000:1.0:1790740334.904371:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158250368 00000100:00100000:1.0:1790740334.904374:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158250368 00000100:00100000:1.0:1790740334.904475:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158250624 00000100:00100000:1.0:1790740334.904478:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158250624 00000100:00100000:1.0:1790740334.904492:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790740334.904506:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1a3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877727158250240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740334.904552:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1a3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877727158250240:12345-0@lo:400:kworker.0 Request processed in 47us (1992us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740334.904558:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790740334.904587:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1790740334.904593:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1a3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1877727158250368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740334.904620:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1a3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1877727158250368:12345-0@lo:400:kworker.0 Request processed in 28us (1890us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740334.904626:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1790740334.904635:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1790740334.904640:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1c3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877727158250624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740334.904679:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1c3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877727158250624:12345-0@lo:400:kworker.0 Request processed in 39us (1177us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740334.904686:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1790740334.904714:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db5a69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1877727158250368:0@lo:400:kworker.0 00000100:00100000:1.0:1790740334.904724:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db6dc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877727158250240:0@lo:400:kworker.0 00010000:00010000:2.0:1790740334.904822:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790740334.905031:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790740334.905051:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1877727158250624:0@lo:400:kworker.0 00000100:00100000:1.0:1790740335.409415:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790740335.409444:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1c3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158250880:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790740335.409531:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740335.411620:0:6703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158250880 00000100:00100000:3.0:1790740335.411635:0:6703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158250880 00000100:00100000:3.0:1790740335.411698:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790740335.411709:0:6703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1a3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158250880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790740335.411762:0:6703:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790740335.411841:0:6703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1a3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158250880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (2309us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740335.411849:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1790740335.412635:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dc1c3ea00 x1877727158250880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740351 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740335.412661:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1c3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158250880:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790740335.500368:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740335.500419:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740335.500449:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740335.500471:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740335.500497:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740335.500533:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133052800 00000100:00100000:0.0:1790740335.500551:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133052800 00000100:00100000:0.0:1790740335.500629:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 222 00000100:00100000:0.0:1790740335.500641:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83fecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:2370:x1877727133052800:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:0.0:1790740335.500728:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83fecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:2370:x1877727133052800:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 88us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740335.500737:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 222 00000100:00100000:2.0:1790740335.502461:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133052928 00000100:00100000:2.0:1790740335.502473:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133052928 00000100:00100000:2.0:1790740335.502537:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133053056 00000100:00100000:2.0:1790740335.502541:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133053056 00000100:00100000:2.0:1790740335.502586:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 64 00000100:00100000:2.0:1790740335.502597:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d84914380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+6:2370:x1877727133052928:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:2.0:1790740335.502688:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d84914380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+6:2370:x1877727133052928:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 93us (2333us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740335.502696:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 64 00000100:00100000:2.0:1790740335.502714:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 65 00000100:00100000:2.0:1790740335.502721:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8498f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+5:2370:x1877727133053056:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:2.0:1790740335.502745:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8498f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+5:2370:x1877727133053056:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 25us (2273us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740335.502763:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 65 00000100:00080000:2.0:1790740335.502782:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790740335.505706:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133053184 00000100:00100000:1.0:1790740335.505724:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133053184 00000100:00100000:1.0:1790740335.505814:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133053312 00000100:00100000:1.0:1790740335.505818:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133053312 00000100:00100000:1.0:1790740335.505852:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 36 00000100:00100000:1.0:1790740335.505864:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8498c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+5:2370:x1877727133053184:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:1.0:1790740335.505967:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8498c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+5:2370:x1877727133053184:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 105us (5546us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740335.505975:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 36 00000100:00100000:1.0:1790740335.505993:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 37 00000100:00100000:1.0:1790740335.506000:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8498f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+5:2370:x1877727133053312:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:1.0:1790740335.506027:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8498f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+5:2370:x1877727133053312:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 27us (5529us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740335.506034:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 37 00000100:00080000:0.0:1790740335.506248:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790740335.506253:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790740335.920915:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790740335.920948:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158251008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790740335.921054:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740335.921249:0:6703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158251008 00000100:00100000:1.0:1790740335.921261:0:6703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158251008 00000100:00100000:1.0:1790740335.921332:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790740335.921344:0:6703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8498d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877727158251008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790740335.921389:0:6703:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790740335.921460:0:6703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8498d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877727158251008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740335.921469:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1790740335.921518:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dc1a3ea00 x1877727158251008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740351 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740335.921539:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158251008:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790740335.921826:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740336.944974:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740337.977426:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790740338.696426:0:10313:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg358-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:3.0:1790740338.999718:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740340.018081:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740340.018333:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158251520:0@lo:400:kworker.0 00000100:00100000:0.0:1790740340.018434:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740340.018511:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1790740340.018518:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1c3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3305:1877727158251136:0@lo:400:kworker.0 00000100:00100000:0.0:1790740340.018553:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740340.018610:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbee18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1877727158251648:0@lo:400:kworker.0 00000100:00100000:0.0:1790740340.018637:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740340.018665:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db5a69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877727158251264:0@lo:400:kworker.0 00000100:00100000:0.0:1790740340.018690:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740340.018710:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbee19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158251776:0@lo:400:kworker.0 00000100:00100000:0.0:1790740340.018756:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740340.018773:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790740340.018778:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db5a69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1877727158251392:0@lo:400:kworker.0 00000100:00100000:0.0:1790740340.018807:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740340.019012:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158251136 00000100:00100000:0.0:1790740340.019022:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158251136 00000100:00100000:0.0:1790740340.019078:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1790740340.019088:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83fec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3305:x1877727158251136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740340.019156:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83fec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3305:x1877727158251136:12345-0@lo:400:kworker.0 Request processed in 69us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740340.019164:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1790740340.019212:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158251648 00000100:00100000:0.0:1790740340.019216:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158251648 00000100:00100000:0.0:1790740340.019250:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158251264 00000100:00100000:0.0:1790740340.019253:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158251264 00000100:00100000:0.0:1790740340.019266:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158251392 00000100:00100000:0.0:1790740340.019269:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158251392 00000100:00100000:0.0:1790740340.019282:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790740340.019288:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8498df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877727158251648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740340.019320:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8498df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877727158251648:12345-0@lo:400:kworker.0 Request processed in 31us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740340.019326:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790740340.019338:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1790740340.019344:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8498ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877727158251264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740340.019373:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8498ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877727158251264:12345-0@lo:400:kworker.0 Request processed in 30us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740340.019379:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1790740340.019391:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1790740340.019397:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc0961f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1877727158251392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740340.019423:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc0961f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1877727158251392:12345-0@lo:400:kworker.0 Request processed in 27us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740340.019436:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:0.0:1790740340.019467:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790740340.019508:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db5a69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1877727158251392:0@lo:400:kworker.0 00000100:00100000:0.0:1790740340.019520:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db5a69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877727158251264:0@lo:400:kworker.0 00000100:00100000:0.0:1790740340.019548:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1c3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3305:1877727158251136:0@lo:400:kworker.0 00000100:00100000:0.0:1790740340.019557:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbee18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1877727158251648:0@lo:400:kworker.0 00000100:00100000:1.0:1790740340.019886:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158251520 00000100:00100000:1.0:1790740340.019891:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158251520 00000100:00100000:1.0:1790740340.019933:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158251776 00000100:00100000:1.0:1790740340.019937:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158251776 00000100:00100000:1.0:1790740340.019958:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790740340.019972:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8498dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158251520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740340.020013:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8498dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158251520:12345-0@lo:400:kworker.0 Request processed in 43us (1581us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740340.020019:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790740340.020034:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1790740340.020040:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc0963b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158251776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740340.020069:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc0963b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158251776:12345-0@lo:400:kworker.0 Request processed in 30us (1312us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740340.020075:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1790740340.021228:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790740340.021235:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790740340.021280:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dbee19880 x1877727158251776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740356 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740340.021297:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbee19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158251776:0@lo:400:kworker.0 00010000:00080000:0.0:1790740340.021338:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dc1a41880 x1877727158251520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740356 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740340.021348:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158251520:0@lo:400:kworker.0 00000100:00100000:0.0:1790740340.535553:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158251904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790740340.535666:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740340.535749:0:6703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158251904 00000100:00100000:1.0:1790740340.535759:0:6703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158251904 00000100:00100000:1.0:1790740340.535831:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790740340.535841:0:6703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc0961c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158251904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790740340.535886:0:6703:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790740340.535946:0:6703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc0961c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158251904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740340.535954:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1790740340.539628:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dc1a3ea00 x1877727158251904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740356 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740340.539664:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158251904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790740340.622442:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740340.622478:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740340.622517:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740340.622557:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740340.622617:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740340.622643:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133053440 00000100:00100000:0.0:1790740340.622652:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133053440 00000100:00100000:3.0:1790740340.622703:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133053824 00000100:00100000:0.0:1790740340.622708:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 224 00000100:00100000:3.0:1790740340.622710:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133053824 00000100:00100000:0.0:1790740340.622731:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83fef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:2369:x1877727133053440:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:3.0:1790740340.622763:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133053952 00000100:00100000:3.0:1790740340.622767:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133053952 00000100:00100000:3.0:1790740340.622789:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 40 00000100:00100000:3.0:1790740340.622797:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc0962680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+5:2369:x1877727133053824:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:1.0:1790740340.622847:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133053568 00000100:00100000:1.0:1790740340.622853:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133053568 00000100:00100000:1.0:1790740340.622887:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133053696 00000100:00100000:1.0:1790740340.622890:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133053696 00000100:00100000:1.0:1790740340.622907:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 69 00000100:00100000:1.0:1790740340.622913:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc0963480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+6:2369:x1877727133053568:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:0.0:1790740340.631680:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83fef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:2369:x1877727133053440:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 8951us (9150us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740340.631694:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 224 00000100:00100000:0.0:1790740340.631772:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 70 00000100:00100000:0.0:1790740340.631786:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc0960700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+5:2369:x1877727133053696:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:3.0:1790740340.636016:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc0962680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+5:2369:x1877727133053824:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 13207us (13524us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740340.636048:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 40 00000100:00100000:1.0:1790740340.636062:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc0963480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+6:2369:x1877727133053568:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 13145us (13637us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740340.636073:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 69 00000100:00100000:3.0:1790740340.636094:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 41 00000100:00100000:3.0:1790740340.636110:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1a41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+5:2369:x1877727133053952:12345-192.168.203.58@tcp:400:kworker.0 00000100:00080000:1.0:1790740340.636286:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790740340.636364:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790740340.636367:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790740340.636522:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1a41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+5:2369:x1877727133053952:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 418us (13902us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740340.636530:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 41 00000100:00100000:0.0:1790740340.647919:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc0960700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+5:2369:x1877727133053696:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 16126us (25348us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740340.647946:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 70 00010000:00010000:1.0:1790740341.041803:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740341.041854:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158252032:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790740341.041924:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740341.042099:0:6703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158252032 00000100:00100000:1.0:1790740341.042106:0:6703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158252032 00000100:00100000:1.0:1790740341.042155:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790740341.042165:0:6703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158252032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790740341.042198:0:6703:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790740341.043438:0:6703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158252032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1272us (1510us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740341.043446:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1790740341.047971:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dc1a3dc00 x1877727158252032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740357 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740341.048005:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158252032:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790740342.064764:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740343.100060:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740344.116494:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740345.136918:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740345.139727:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d9018fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158252544:0@lo:400:kworker.0 00000100:00100000:2.0:1790740345.139798:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740345.139850:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1790740345.139856:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d9018ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3305:1877727158252160:0@lo:400:kworker.0 00000100:00100000:2.0:1790740345.139882:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740345.139906:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d9018e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1877727158252672:0@lo:400:kworker.0 00000100:00100000:2.0:1790740345.139941:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740345.139968:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d9018e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877727158252288:0@lo:400:kworker.0 00000100:00100000:2.0:1790740345.140001:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740345.140019:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d9018c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158252800:0@lo:400:kworker.0 00000100:00100000:2.0:1790740345.140053:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740345.140072:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790740345.140077:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d9018f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1877727158252416:0@lo:400:kworker.0 00000100:00100000:2.0:1790740345.140123:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740345.140157:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158252160 00000100:00100000:2.0:1790740345.140165:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158252160 00000100:00100000:2.0:1790740345.140435:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1790740345.140446:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83fedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3305:x1877727158252160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740345.140496:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83fedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3305:x1877727158252160:12345-0@lo:400:kworker.0 Request processed in 53us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740345.140504:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1790740345.140623:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158252672 00000100:00100000:2.0:1790740345.140627:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158252672 00000100:00100000:2.0:1790740345.140659:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158252288 00000100:00100000:2.0:1790740345.140661:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158252288 00000100:00100000:2.0:1790740345.140671:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158252416 00000100:00100000:2.0:1790740345.140674:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158252416 00000100:00100000:2.0:1790740345.140697:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790740345.140703:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d9018d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877727158252672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740345.140735:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d9018d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877727158252672:12345-0@lo:400:kworker.0 Request processed in 32us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740345.140741:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790740345.140753:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1790740345.140759:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d9018c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877727158252288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740345.140790:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d9018c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877727158252288:12345-0@lo:400:kworker.0 Request processed in 32us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740345.140796:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1790740345.140815:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1790740345.140822:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d87e20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1877727158252416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740345.140847:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d87e20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1877727158252416:12345-0@lo:400:kworker.0 Request processed in 27us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740345.140854:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1790740345.140894:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d9018f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1877727158252416:0@lo:400:kworker.0 00000100:00100000:2.0:1790740345.140904:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d9018e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877727158252288:0@lo:400:kworker.0 00000100:00100000:2.0:1790740345.140929:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d9018ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3305:1877727158252160:0@lo:400:kworker.0 00000100:00100000:2.0:1790740345.140937:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d9018e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1877727158252672:0@lo:400:kworker.0 00000100:00100000:1.0:1790740345.148768:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158252544 00000100:00100000:1.0:1790740345.148783:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158252544 00000100:00100000:1.0:1790740345.148842:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158252800 00000100:00100000:1.0:1790740345.148847:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158252800 00000100:00100000:1.0:1790740345.148874:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790740345.148883:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1e55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158252544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740345.149045:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790740345.149056:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d9018ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158252800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740345.149160:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d9018ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158252800:12345-0@lo:400:kworker.0 Request processed in 108us (9105us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740345.149166:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1790740345.149215:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0d9018c380 x1877727158252800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740345.149230:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d9018c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158252800:0@lo:400:kworker.0 00000100:00100000:1.0:1790740345.149395:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1e55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158252544:12345-0@lo:400:kworker.0 Request processed in 514us (9597us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740345.149403:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1790740345.149727:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0d9018fb80 x1877727158252544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740345.149739:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d9018fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158252544:0@lo:400:kworker.0 00000100:00080000:1.0:1790740345.149813:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790740345.149818:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790740345.149820:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790740345.649781:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1c3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158252928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790740345.649849:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740345.649949:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158252928 00000100:00100000:0.0:1790740345.649956:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158252928 00000100:00100000:0.0:1790740345.650008:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790740345.650018:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d87e21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158252928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790740345.650052:0:6704:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790740345.650148:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d87e21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158252928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740345.650154:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1790740345.650233:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dc1c3f100 x1877727158252928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740361 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740345.650250:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1c3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158252928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790740345.744943:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740345.744988:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740345.744995:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133054208 00000100:00100000:1.0:1790740345.745005:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133054208 00000100:00100000:2.0:1790740345.745023:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740345.745040:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740345.745057:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133054336 00000100:00100000:1.0:1790740345.745060:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133054336 00000100:00100000:2.0:1790740345.745062:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740345.745082:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 74 00000100:00100000:1.0:1790740345.745095:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d87e22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+6:2370:x1877727133054208:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:1.0:1790740345.745188:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d87e22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+6:2370:x1877727133054208:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 98us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740345.745278:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133054464 00000100:00100000:0.0:1790740345.745283:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133054464 00000100:00100000:0.0:1790740345.745311:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133054592 00000100:00100000:0.0:1790740345.745313:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133054592 00000100:00100000:0.0:1790740345.745333:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 44 00000100:00100000:0.0:1790740345.745340:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d87e21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+5:2370:x1877727133054464:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:0.0:1790740345.745369:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d87e21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+5:2370:x1877727133054464:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 30us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740345.745376:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 44 00000100:00100000:0.0:1790740345.745392:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 45 00000100:00100000:0.0:1790740345.745398:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d87e23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+5:2370:x1877727133054592:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:0.0:1790740345.745420:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d87e23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+5:2370:x1877727133054592:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 22us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740345.745426:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 45 00000100:00100000:2.0:1790740345.753438:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 75 00000100:00100000:2.0:1790740345.753489:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d87e21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+5:2370:x1877727133054336:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:2.0:1790740345.753593:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d87e21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+5:2370:x1877727133054336:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 124us (8550us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740345.753601:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 75 00000100:00100000:1.0:1790740345.754255:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 74 00000100:00080000:1.0:1790740345.754280:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790740345.754285:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790740345.754288:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790740345.754303:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133054080 00000100:00100000:1.0:1790740345.754311:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133054080 00000100:00100000:1.0:1790740345.754355:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 226 00000100:00100000:1.0:1790740345.754363:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83fed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:2370:x1877727133054080:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:1.0:1790740345.754397:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83fed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:2370:x1877727133054080:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 35us (9372us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740345.754404:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 226 00000100:00100000:2.0:1790740346.161689:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d87e22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158253056:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790740346.161760:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740346.161827:0:6703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158253056 00000100:00100000:2.0:1790740346.161834:0:6703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158253056 00000100:00100000:2.0:1790740346.161875:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790740346.161883:0:6703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d87e22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158253056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790740346.161917:0:6703:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790740346.161965:0:6703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d87e22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158253056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740346.161972:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1790740346.162006:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0d87e22d80 x1877727158253056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740362 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740346.162022:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d87e22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158253056:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1790740346.170109:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740347.202354:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740348.209547:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740349.240237:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740350.257013:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d87e22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3306:1877727158253184:0@lo:400:kworker.0 00000100:00100000:2.0:1790740350.257094:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740350.257139:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d87e20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1877727158253696:0@lo:400:kworker.0 00000100:00100000:2.0:1790740350.257163:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740350.257379:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790740350.257385:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d87e22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158253568:0@lo:400:kworker.0 00000100:00100000:2.0:1790740350.257423:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740350.257447:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d87e23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1877727158253440:0@lo:400:kworker.0 00000100:00100000:2.0:1790740350.257467:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740350.257483:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1790740350.257488:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d87e23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877727158253312:0@lo:400:kworker.0 00000100:00100000:2.0:1790740350.257506:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740350.257518:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d87e20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158253824:0@lo:400:kworker.0 00000100:00100000:2.0:1790740350.257535:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740350.257558:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158253184 00000100:00100000:2.0:1790740350.257565:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158253184 00000100:00100000:2.0:1790740350.257622:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1790740350.257629:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83fec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3306:x1877727158253184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740350.257684:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83fec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3306:x1877727158253184:12345-0@lo:400:kworker.0 Request processed in 54us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740350.257690:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1790740350.257714:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158253696 00000100:00100000:2.0:1790740350.257718:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158253696 00000100:00100000:2.0:1790740350.257746:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158253440 00000100:00100000:2.0:1790740350.257748:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158253440 00000100:00100000:2.0:1790740350.257758:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158253312 00000100:00100000:2.0:1790740350.257760:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158253312 00000100:00100000:2.0:1790740350.257771:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1790740350.257777:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d87e21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877727158253696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740350.257810:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d87e21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877727158253696:12345-0@lo:400:kworker.0 Request processed in 33us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740350.257816:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1790740350.257827:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1790740350.257842:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d87e21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877727158253440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740350.257876:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d87e21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877727158253440:12345-0@lo:400:kworker.0 Request processed in 35us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740350.257882:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1790740350.257907:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1790740350.257913:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d87e20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877727158253312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740350.257940:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d87e20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877727158253312:12345-0@lo:400:kworker.0 Request processed in 27us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740350.257946:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1790740350.257968:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158253568 00000100:00100000:2.0:1790740350.257971:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158253568 00000100:00100000:2.0:1790740350.257992:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158253824 00000100:00100000:2.0:1790740350.257994:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158253824 00000100:00100000:2.0:1790740350.258010:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790740350.258017:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d87e20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1877727158253568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740350.258044:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d87e20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1877727158253568:12345-0@lo:400:kworker.0 Request processed in 29us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740350.258050:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790740350.258059:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790740350.258064:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d87e23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158253824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740350.258456:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d87e23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158253824:12345-0@lo:400:kworker.0 Request processed in 390us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740350.258463:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:2.0:1790740350.258484:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790740350.258487:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790740350.258490:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790740350.258525:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d87e23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877727158253312:0@lo:400:kworker.0 00010000:00080000:2.0:1790740350.258548:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0d87e20e00 x1877727158253824/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740366 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740350.258559:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d87e20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158253824:0@lo:400:kworker.0 00010000:00080000:0.0:1790740350.258629:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0d87e22300 x1877727158253568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740366 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740350.258638:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d87e22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158253568:0@lo:400:kworker.0 00000100:00100000:0.0:1790740350.258657:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d87e22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3306:1877727158253184:0@lo:400:kworker.0 00000100:00100000:0.0:1790740350.258667:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d87e20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1877727158253696:0@lo:400:kworker.0 00000100:00100000:2.0:1790740350.258717:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d87e23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1877727158253440:0@lo:400:kworker.0 00010000:00010000:2.0:1790740350.259408:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740350.770882:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790740350.770905:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1c3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158253952:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790740350.770968:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740350.771044:0:6703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158253952 00000100:00100000:0.0:1790740350.771267:0:6703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158253952 00000100:00100000:0.0:1790740350.771316:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790740350.771325:0:6703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158253952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790740350.771431:0:6703:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790740350.771672:0:6703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158253952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 347us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740350.771680:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1790740350.771723:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dc1c3ce00 x1877727158253952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740366 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740350.771743:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1c3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158253952:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790740350.861078:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740350.861118:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740350.861152:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740350.861231:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740350.861260:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740350.861479:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133055104 00000100:00100000:2.0:1790740350.861489:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133055104 00000100:00100000:2.0:1790740350.861552:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133055232 00000100:00100000:2.0:1790740350.861555:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133055232 00000100:00100000:2.0:1790740350.861592:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 14 00000100:00100000:2.0:1790740350.861601:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+5:2368:x1877727133055104:12345-192.168.203.58@tcp:9:kworker.0 00000020:00000080:2.0:1790740350.861627:0:6700:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc6b31a1b598e9ccd 00000100:00080000:2.0:1790740350.861635:0:6700:0:(import.c:65:import_set_state_nolock()) ffff8f0db6f4b000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790740350.861681:0:6700:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1790740350.862016:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+2:2368:x1877727133055104:12345-192.168.203.58@tcp:9:kworker.0 Request processed in 414us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740350.862024:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 14 00000100:00100000:2.0:1790740350.862039:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 15 00000100:00100000:2.0:1790740350.862046:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1c3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+5:2368:x1877727133055232:12345-192.168.203.58@tcp:9:kworker.0 00000020:00000080:2.0:1790740350.862060:0:6700:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc6b31a1b598e9cd4 00000100:00080000:2.0:1790740350.862064:0:6700:0:(import.c:65:import_set_state_nolock()) ffff8f0db6f4d800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790740350.862084:0:6700:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1790740350.862280:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1c3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+2:2368:x1877727133055232:12345-192.168.203.58@tcp:9:kworker.0 Request processed in 234us (1160us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740350.862287:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 15 00000100:00100000:2.0:1790740350.862321:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133054720 00000100:00100000:2.0:1790740350.862335:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133054720 00000100:00100000:2.0:1790740350.862361:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 228 00000100:00100000:2.0:1790740350.862367:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:2370:x1877727133054720:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:2.0:1790740350.862392:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:2370:x1877727133054720:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 26us (1241us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740350.862398:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 228 00000100:00100000:2.0:1790740350.862422:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133054976 00000100:00100000:2.0:1790740350.862426:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133054976 00000100:00100000:2.0:1790740350.862447:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133054848 00000100:00100000:2.0:1790740350.862449:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133054848 00000100:00100000:2.0:1790740350.862464:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 79 00000100:00100000:2.0:1790740350.862470:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1c3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+5:2370:x1877727133054976:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:2.0:1790740350.862498:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1c3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+5:2370:x1877727133054976:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 28us (1267us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740350.862505:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 79 00000100:00100000:2.0:1790740350.862517:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 80 00000100:00100000:2.0:1790740350.862523:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1c3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+6:2370:x1877727133054848:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:2.0:1790740350.862546:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1c3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+6:2370:x1877727133054848:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 23us (1284us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740350.862552:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 80 00010000:00010000:2.0:1790740350.862596:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740350.862720:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790740350.865981:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790740350.865990:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790740350.865993:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790740351.284615:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740351.284729:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbee18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158254080:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790740351.284795:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740351.294445:0:6703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158254080 00000100:00100000:0.0:1790740351.294462:0:6703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158254080 00000100:00100000:0.0:1790740351.294530:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790740351.294541:0:6703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d87e23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158254080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790740351.294596:0:6703:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790740351.294799:0:6703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d87e23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158254080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 260us (10003us total) trans 0 rc 0/0 00010000:00080000:2.0:1790740351.294807:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dbee18a80 x1877727158254080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740367 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740351.294812:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790740351.294834:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbee18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158254080:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1790740351.868945:0:7642:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e4b31cba-b68c-42cd-8636-ffe05cdf5b69 00000020:00000080:0.0:1790740351.868959:0:7642:0:(genops.c:885:class_export_put()) final put ffff8f0db6f4f000/e4b31cba-b68c-42cd-8636-ffe05cdf5b69 00000020:00000080:0.0:1790740351.869003:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f0db6f4f000/e4b31cba-b68c-42cd-8636-ffe05cdf5b69 for lustre-OST0001 00000020:00000080:0.0:1790740351.869292:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f0db6f4d800 for lustre-OST0001 00010000:00010000:2.0:1790740352.308200:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740353.328808:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740354.355590:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740355.376915:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740355.383915:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790740355.383935:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3305:1877727158254208:0@lo:400:kworker.0 00000100:00100000:1.0:1790740355.383997:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740355.384049:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158254208 00000100:00100000:1.0:1790740355.384055:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158254208 00000100:00100000:1.0:1790740355.384203:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1790740355.384212:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3305:x1877727158254208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740355.384257:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3305:x1877727158254208:12345-0@lo:400:kworker.0 Request processed in 47us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740355.384264:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1790740355.384305:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3305:1877727158254208:0@lo:400:kworker.0 00000100:00100000:1.0:1790740355.384339:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790740355.384356:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877727158254336:0@lo:400:kworker.0 00000100:00100000:1.0:1790740355.384381:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740355.384406:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158254336 00000100:00100000:1.0:1790740355.384409:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158254336 00000100:00100000:1.0:1790740355.384432:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1790740355.384437:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877727158254336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740355.384466:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877727158254336:12345-0@lo:400:kworker.0 Request processed in 29us (85us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740355.384472:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1790740355.384497:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877727158254336:0@lo:400:kworker.0 00000100:00100000:1.0:1790740355.384524:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1877727158254464:0@lo:400:kworker.0 00000100:00100000:1.0:1790740355.384546:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740355.384637:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158254464 00000100:00100000:1.0:1790740355.384641:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158254464 00000100:00100000:1.0:1790740355.384671:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1790740355.384678:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1a3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877727158254464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740355.384712:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1a3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877727158254464:12345-0@lo:400:kworker.0 Request processed in 35us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740355.384719:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1790740355.384744:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1877727158254464:0@lo:400:kworker.0 00000100:00080000:0.0:1790740355.384912:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790740355.385821:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790740355.385837:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1c3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158254592:0@lo:400:kworker.0 00000100:00100000:0.0:1790740355.385879:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740355.385915:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158254592 00000100:00100000:0.0:1790740355.385921:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158254592 00000100:00100000:0.0:1790740355.385960:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790740355.385968:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db5a6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1877727158254592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740355.386008:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db5a6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1877727158254592:12345-0@lo:400:kworker.0 Request processed in 41us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740355.386014:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1790740355.386031:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790740355.386056:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dc1c3f100 x1877727158254592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740355.386068:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1c3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158254592:0@lo:400:kworker.0 00000100:00100000:0.0:1790740355.386116:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db5a6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1877727158254720:0@lo:400:kworker.0 00000100:00100000:0.0:1790740355.386317:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740355.386362:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db5a6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158254848:0@lo:400:kworker.0 00000100:00100000:0.0:1790740355.386388:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740355.386415:0:8460:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158254848 00000100:00100000:0.0:1790740355.386418:0:8460:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158254848 00000100:00100000:0.0:1790740355.386447:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790740355.386454:0:8460:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db5a69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158254848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740355.386503:0:8460:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db5a69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158254848:12345-0@lo:400:kworker.0 Request processed in 50us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740355.386510:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:0.0:1790740355.386525:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1790740355.386543:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0db5a6aa00 x1877727158254848/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740355.386552:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db5a6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158254848:0@lo:400:kworker.0 00000100:00100000:1.0:1790740355.390463:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158254720 00000100:00100000:1.0:1790740355.390478:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158254720 00000100:00100000:1.0:1790740355.390551:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1790740355.390561:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db5a69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877727158254720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740355.390684:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db5a69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877727158254720:12345-0@lo:400:kworker.0 Request processed in 124us (4367us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740355.390707:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1790740355.390766:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db5a6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1877727158254720:0@lo:400:kworker.0 00000100:00080000:3.0:1790740355.391381:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790740355.896180:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790740355.896204:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db5a6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158254976:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790740355.896272:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740355.897027:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158254976 00000100:00100000:2.0:1790740355.897037:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158254976 00000100:00100000:2.0:1790740355.897082:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790740355.897091:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db5a69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158254976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790740355.897127:0:6704:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790740355.897193:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db5a69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158254976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740355.897201:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1790740355.897245:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0db5a6aa00 x1877727158254976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740371 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740355.897263:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db5a6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158254976:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790740355.983315:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740355.983367:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740355.983392:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740355.984034:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133055616 00000100:00100000:0.0:1790740355.984044:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133055616 00000100:00100000:0.0:1790740355.984216:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133055488 00000100:00100000:0.0:1790740355.984220:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133055488 00000100:00100000:1.0:1790740355.984310:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 84 00000100:00100000:1.0:1790740355.984323:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+5:2372:x1877727133055616:12345-192.168.203.58@tcp:400:kworker.0 00000100:00080000:3.0:1790740355.984930:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790740355.985232:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 85 00000100:00100000:0.0:1790740355.985244:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+6:2372:x1877727133055488:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:0.0:1790740355.985320:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+6:2372:x1877727133055488:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 79us (1927us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740355.985329:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 85 00000100:00100000:1.0:1790740355.985855:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+5:2372:x1877727133055616:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 1533us (2484us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740355.985863:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 84 00000100:00100000:2.0:1790740355.986114:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133055360 00000100:00100000:2.0:1790740355.986122:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133055360 00000100:00100000:2.0:1790740355.986307:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 230 00000100:00100000:2.0:1790740355.986315:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:2372:x1877727133055360:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:2.0:1790740355.988255:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:2372:x1877727133055360:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 1931us (4945us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740355.988269:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 230 00000001:00100000:0.0:1790740356.034472:0:6725:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e4b31cba-b68c-42cd-8636-ffe05cdf5b69 00000020:00000080:0.0:1790740356.034480:0:6725:0:(genops.c:885:class_export_put()) final put ffff8f0db6f48000/e4b31cba-b68c-42cd-8636-ffe05cdf5b69 00000020:00000080:2.0:1790740356.034642:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f0db6f48000/e4b31cba-b68c-42cd-8636-ffe05cdf5b69 for lustre-OST0000 00000020:00000080:2.0:1790740356.034695:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f0db6f4b000 for lustre-OST0000 00010000:00010000:2.0:1790740356.401099:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740356.401931:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790740356.401952:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbee1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158255104:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790740356.402020:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740356.402218:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158255104 00000100:00100000:2.0:1790740356.402227:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158255104 00000100:00100000:2.0:1790740356.402279:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790740356.402289:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db5a6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877727158255104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790740356.402325:0:6704:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790740356.402376:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db5a6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877727158255104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740356.402384:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1790740356.402467:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dbee1b800 x1877727158255104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740372 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740356.402486:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbee1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158255104:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790740357.424853:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740358.449446:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740359.473902:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790740360.260391:0:11017:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1790740360.496967:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db5a6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3306:1877727158255232:0@lo:400:kworker.0 00000100:00100000:0.0:1790740360.497011:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1c3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877727158255360:0@lo:400:kworker.0 00000100:00100000:1.0:1790740360.497046:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740360.497100:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd7d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1877727158255744:0@lo:400:kworker.0 00000100:00100000:1.0:1790740360.497125:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740360.497215:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740360.497236:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd7d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158255616:0@lo:400:kworker.0 00000100:00100000:0.0:1790740360.497242:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd7d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158255872:0@lo:400:kworker.0 00000100:00100000:3.0:1790740360.497283:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740360.497318:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158255616 00000100:00100000:3.0:1790740360.497323:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd7d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1877727158255488:0@lo:400:kworker.0 00000100:00100000:0.0:1790740360.497327:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158255616 00000100:00100000:3.0:1790740360.497350:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790740360.497379:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790740360.497387:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790740360.497393:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158255744 00000100:00100000:3.0:1790740360.497397:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158255744 00000100:00100000:0.0:1790740360.497399:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158255616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740360.497428:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158255360 00000100:00100000:3.0:1790740360.497432:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158255360 00000100:00100000:3.0:1790740360.497446:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158255488 00000100:00100000:3.0:1790740360.497448:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158255488 00000100:00100000:3.0:1790740360.497466:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1790740360.497467:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158255616:12345-0@lo:400:kworker.0 Request processed in 68us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740360.497474:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1a3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877727158255744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740360.497477:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790740360.497528:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1a3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877727158255744:12345-0@lo:400:kworker.0 Request processed in 55us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740360.497534:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1790740360.497549:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1790740360.497554:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd7d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877727158255360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740360.497605:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd7d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877727158255360:12345-0@lo:400:kworker.0 Request processed in 50us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740360.497610:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1790740360.497621:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1790740360.497626:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877727158255488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740360.497650:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877727158255488:12345-0@lo:400:kworker.0 Request processed in 24us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740360.497656:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:3.0:1790740360.497670:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1790740360.497690:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dbd7d5f80 x1877727158255616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740360.497708:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd7d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158255616:0@lo:400:kworker.0 00000100:00100000:3.0:1790740360.497729:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740360.497756:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1c3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877727158255360:0@lo:400:kworker.0 00000100:00100000:3.0:1790740360.497778:0:8460:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158255872 00000100:00100000:0.0:1790740360.497781:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd7d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1877727158255488:0@lo:400:kworker.0 00000100:00100000:3.0:1790740360.497782:0:8460:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158255872 00000100:00100000:3.0:1790740360.497813:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1790740360.497819:0:8460:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158255872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740360.497855:0:8460:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158255872:12345-0@lo:400:kworker.0 Request processed in 36us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740360.497861:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:3.0:1790740360.497874:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790740360.498010:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd7d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1877727158255744:0@lo:400:kworker.0 00000100:00100000:1.0:1790740360.498033:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158255232 00000100:00100000:1.0:1790740360.498037:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158255232 00010000:00080000:0.0:1790740360.498072:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dbd7d5c00 x1877727158255872/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740360.498084:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd7d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158255872:0@lo:400:kworker.0 00000100:00100000:1.0:1790740360.498122:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1790740360.498131:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3306:x1877727158255232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740360.498180:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3306:x1877727158255232:12345-0@lo:400:kworker.0 Request processed in 49us (1134us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740360.498186:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1790740360.498269:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db5a6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3306:1877727158255232:0@lo:400:kworker.0 00010000:00010000:2.0:1790740360.501096:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740361.009458:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790740361.009478:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd7d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158256000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790740361.009546:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740361.009801:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158256000 00000100:00100000:3.0:1790740361.009810:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158256000 00000100:00100000:3.0:1790740361.009863:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790740361.009872:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd7d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158256000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790740361.009905:0:6704:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790740361.009952:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd7d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158256000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740361.009959:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1790740361.010884:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dbd7d5c00 x1877727158256000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740377 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740361.010906:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd7d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158256000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790740361.099699:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740361.099750:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740361.099787:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740361.099981:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133056000 00000100:00100000:0.0:1790740361.099996:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133056000 00000100:00100000:0.0:1790740361.100070:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133055872 00000100:00100000:0.0:1790740361.100074:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133055872 00000100:00100000:0.0:1790740361.100115:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 89 00000100:00100000:0.0:1790740361.100129:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+5:2371:x1877727133056000:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:1.0:1790740361.100204:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 90 00000100:00100000:1.0:1790740361.100233:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+6:2371:x1877727133055872:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:0.0:1790740361.100245:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+5:2371:x1877727133056000:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 116us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740361.100280:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 89 00000100:00100000:1.0:1790740361.100336:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+6:2371:x1877727133055872:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 117us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740361.100346:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 90 00000100:00080000:3.0:1790740361.101138:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790740361.105263:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133055744 00000100:00100000:2.0:1790740361.105279:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133055744 00000100:00100000:2.0:1790740361.105357:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 232 00000100:00100000:2.0:1790740361.105367:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:2371:x1877727133055744:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:2.0:1790740361.105450:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:2371:x1877727133055744:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 85us (5766us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740361.105457:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 232 00000100:00100000:3.0:1790740361.522725:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790740361.522748:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbee1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158256128:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790740361.522829:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740361.522894:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158256128 00000100:00100000:3.0:1790740361.522901:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158256128 00000100:00100000:3.0:1790740361.522944:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790740361.522953:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877727158256128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790740361.522985:0:6704:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790740361.523027:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877727158256128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740361.523033:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1790740361.523076:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dbee1b480 x1877727158256128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740377 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740361.523093:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbee1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158256128:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790740361.527030:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740362.544819:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740363.568818:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1790740363.777811:0:11164:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdd4aa24f0 20000000:00000080:3.0:1790740363.777829:0:11164:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f0dbd2a4000 uarg=0000000000000000 20000000:01000000:3.0:1790740363.777952:0:11164:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1790740363.777958:0:11164:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1790740363.777963:0:11164:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1790740363.778568:0:11165:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1790740363.778826:0:11164:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1790740363.786030:0:11164:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1790740363.786203:0:11164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f0d9fea7400/0xc6b31a1b598e9cdb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740363.786224:0:11164:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0d9f976600/0xc6b31a1b598e9c80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee366 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740363.786233:0:11164:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0d9f498000/0xc6b31a1b598e9c8e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e9c87 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740363.786240:0:11164:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0d87594800/0xc6b31a1b598e9c9c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e9c95 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740363.786246:0:11164:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0d87595400/0xc6b31a1b598e9caa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e9ca3 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740363.786253:0:11164:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0d9fea6800/0xc6b31a1b598e9cbf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee39e expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740363.786261:0:11164:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f0d9fea7400/0xc6b31a1b598e9cdb lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740363.786303:0:11164:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0d9fea6800/0xc6b31a1b598e9cbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee39e expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740363.786319:0:11164:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f0d9fea6800/0xc6b31a1b598e9cbf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee39e expref: 12 pid: 5836 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740363.786333:0:11164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd7d7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11164:1877727158256256:192.168.203.58@tcp:104: 00010000:00010000:0.0:1790740363.786628:0:11164:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0d87595400/0xc6b31a1b598e9caa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b31a1b598e9ca3 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740363.786638:0:11164:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f0d87595400/0xc6b31a1b598e9caa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b31a1b598e9ca3 expref: 18 pid: 5836 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740363.786648:0:11164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd7d6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11164:1877727158256384:0@lo:104: 00000100:00100000:0.0:1790740363.786687:0:11164:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790740363.786726:0:11164:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0d87594800/0xc6b31a1b598e9c9c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b31a1b598e9c95 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740363.786734:0:11164:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f0d87594800/0xc6b31a1b598e9c9c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b31a1b598e9c95 expref: 18 pid: 5836 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740363.786742:0:11164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd7d7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11164:1877727158256512:0@lo:104: 00000100:00100000:0.0:1790740363.786766:0:11164:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790740363.786793:0:11164:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0d9f498000/0xc6b31a1b598e9c8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b31a1b598e9c87 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740363.786801:0:11164:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f0d9f498000/0xc6b31a1b598e9c8e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b31a1b598e9c87 expref: 18 pid: 5837 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740363.786808:0:11164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd7d6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11164:1877727158256640:0@lo:104: 00000100:00100000:0.0:1790740363.786825:0:11164:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790740363.786838:0:11164:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0d9f976600/0xc6b31a1b598e9c80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee366 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740363.786846:0:11164:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f0d9f976600/0xc6b31a1b598e9c80 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee366 expref: 12 pid: 5837 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740363.786866:0:11164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd7d4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11164:1877727158256768:192.168.203.58@tcp:104: 00000100:00100000:2.0:1790740363.786877:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158256384 00000100:00100000:0.0:1790740363.786890:0:11164:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d87549780 going to sleep for 11 seconds 00000100:00100000:2.0:1790740363.786949:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158256384 00000100:00100000:2.0:1790740363.787055:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158256512 00000100:00100000:2.0:1790740363.787059:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158256512 00000100:00100000:2.0:1790740363.787071:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158256640 00000100:00100000:2.0:1790740363.787074:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158256640 00000100:00100000:2.0:1790740363.787087:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790740363.787095:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd7d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+5:11164:x1877727158256384:12345-0@lo:104: 00010000:00010000:2.0:1790740363.787108:0:5826:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499200/0xc6b31a1b598e9ca3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598e9caa expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740363.789075:0:5826:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790740363.789088:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd7d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+5:11164:x1877727158256384:12345-0@lo:104: Request processed in 1990us (2397us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740363.789099:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790740363.789129:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790740363.789138:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd7d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+4:11164:x1877727158256512:12345-0@lo:104: 00010000:00010000:3.0:1790740363.789143:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740363.789152:0:5831:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499200/0xc6b31a1b598e9ca3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598e9caa expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740363.789160:0:5831:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f499200 already unused, calling callback (ffffffffc1baec20) 10000000:00010000:3.0:1790740363.789164:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499200/0xc6b31a1b598e9ca3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b31a1b598e9caa expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740363.789187:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499200/0xc6b31a1b598e9ca3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b31a1b598e9caa expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790740363.789195:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499200/0xc6b31a1b598e9ca3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b31a1b598e9caa expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740363.789200:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790740363.789244:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499200/0xc6b31a1b598e9ca3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9caa expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740363.789251:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790740363.789271:0:5831:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499200/0xc6b31a1b598e9ca3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9caa expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740363.789277:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499200/0xc6b31a1b598e9ca3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9caa expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740363.789290:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740363.789292:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740363.789293:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740363.789314:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbee1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3306:1877727158256896:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790740363.789364:0:11164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd7d6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11164:1877727158256384:0@lo:104: 00010000:00010000:2.0:1790740363.789627:0:5826:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.158@tcp lock: ffff8f0d87594000/0xc6b31a1b598e9c95 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598e9c9c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740363.789648:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790740363.789684:0:5826:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790740363.789690:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd7d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+4:11164:x1877727158256512:12345-0@lo:104: Request processed in 555us (2923us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740363.789696:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790740363.789711:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790740363.789718:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd7d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+3:11164:x1877727158256640:12345-0@lo:104: 00000100:00100000:0.0:1790740363.789723:0:8506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158256896 00010000:00010000:2.0:1790740363.789726:0:5826:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea6a00/0xc6b31a1b598e9c87 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598e9c8e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740363.789728:0:8506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158256896 00010000:00010000:0.0:1790740363.789751:0:8506:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0d87595400/0xc6b31a1b598e9caa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598e9ca3 expref: 19 pid: 5836 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740363.789768:0:5826:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790740363.789773:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd7d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+3:11164:x1877727158256640:12345-0@lo:104: Request processed in 56us (2947us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740363.789773:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790740363.789779:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790740363.789779:0:8506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d87401450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3306:x1877727158256896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790740363.789789:0:8506:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740363.789794:0:8506:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0d87595400/0xc6b31a1b598e9caa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598e9ca3 expref: 19 pid: 5836 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740363.789796:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790740363.789801:0:5832:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.158@tcp lock: ffff8f0d87594000/0xc6b31a1b598e9c95 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598e9c9c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740363.789802:0:8506:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0d87595400/0xc6b31a1b598e9caa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b31a1b598e9ca3 expref: 19 pid: 5836 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740363.789816:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0d87595400/0xc6b31a1b598e9caa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b31a1b598e9ca3 expref: 19 pid: 5836 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740363.789818:0:5832:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87594000 already unused, calling callback (ffffffffc1baec20) 10000000:00010000:2.0:1790740363.789821:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.158@tcp lock: ffff8f0d87594000/0xc6b31a1b598e9c95 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b31a1b598e9c9c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740363.789828:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.158@tcp lock: ffff8f0d87594000/0xc6b31a1b598e9c95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b31a1b598e9c9c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740363.789828:0:8506:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 10000000:00010000:2.0:1790740363.789835:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.158@tcp lock: ffff8f0d87594000/0xc6b31a1b598e9c95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b31a1b598e9c9c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790740363.789840:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1790740363.789853:0:8506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d87401450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10ce3df1-3f26-4bb4-b4c3-d740981d121e+18:3306:x1877727158256896:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (205us total) trans 0 rc 0/0 00010000:00010000:2.0:1790740363.789857:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.158@tcp lock: ffff8f0d87594000/0xc6b31a1b598e9c95 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9c9c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740363.789859:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:2.0:1790740363.789862:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790740363.789877:0:5832:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.158@tcp lock: ffff8f0d87594000/0xc6b31a1b598e9c95 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9c9c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740363.789894:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.158@tcp lock: ffff8f0d87594000/0xc6b31a1b598e9c95 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9c9c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740363.789903:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790740363.789906:0:5832:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea6a00/0xc6b31a1b598e9c87 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598e9c8e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740363.789911:0:5832:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9fea6a00 already unused, calling callback (ffffffffc1baec20) 10000000:00010000:2.0:1790740363.789914:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea6a00/0xc6b31a1b598e9c87 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b31a1b598e9c8e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740363.789929:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea6a00/0xc6b31a1b598e9c87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b31a1b598e9c8e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740363.789931:0:11164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd7d7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11164:1877727158256512:0@lo:104: 10000000:00010000:2.0:1790740363.789936:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea6a00/0xc6b31a1b598e9c87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b31a1b598e9c8e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740363.789938:0:11164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd7d6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11164:1877727158256640:0@lo:104: 10000000:01000000:2.0:1790740363.789942:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790740363.789956:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea6a00/0xc6b31a1b598e9c87 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9c8e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740363.789961:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790740363.789969:0:5832:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea6a00/0xc6b31a1b598e9c87 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9c8e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740363.789975:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea6a00/0xc6b31a1b598e9c87 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9c8e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740363.789981:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740363.789986:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740363.789988:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740363.789989:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740363.789995:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbee1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3306:1877727158256896:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790740363.789998:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d87e20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3303:1877727158257024:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790740363.790023:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740363.790047:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790740363.790053:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d87e23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3303:1877727158257152:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790740363.790073:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740363.790099:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158257024 00000100:00100000:0.0:1790740363.790099:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158257152 00000100:00100000:2.0:1790740363.790103:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158257024 00000100:00100000:0.0:1790740363.790107:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158257152 00010000:00010000:2.0:1790740363.790116:0:5829:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0d87594800/0xc6b31a1b598e9c9c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598e9c95 expref: 19 pid: 5836 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740363.790117:0:5828:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0d9f498000/0xc6b31a1b598e9c8e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598e9c87 expref: 19 pid: 5837 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740363.790136:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790740363.790140:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790740363.790141:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d87e22d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3303:x1877727158257152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790740363.790148:0:5828:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740363.790153:0:5828:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0d9f498000/0xc6b31a1b598e9c8e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598e9c87 expref: 19 pid: 5837 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740363.790161:0:5828:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0d9f498000/0xc6b31a1b598e9c8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b31a1b598e9c87 expref: 19 pid: 5837 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740363.790170:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0d9f498000/0xc6b31a1b598e9c8e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b31a1b598e9c87 expref: 19 pid: 5837 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740363.790178:0:5828:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740363.790206:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d87e22d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+18:3303:x1877727158257152:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740363.790341:0:11164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd7d7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11164:1877727158256256:192.168.203.58@tcp:104: 00000100:00100000:3.0:1790740363.790350:0:11164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd7d4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11164:1877727158256768:192.168.203.58@tcp:104: 00010000:00010000:3.0:1790740363.790374:0:11164:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f0d9fea7400/0xc6b31a1b598e9cdb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740363.790610:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d87e20380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+18:3303:x1877727158257024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790740363.790619:0:5829:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740363.790624:0:5829:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0d87594800/0xc6b31a1b598e9c9c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598e9c95 expref: 18 pid: 5836 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740363.790633:0:5829:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0d87594800/0xc6b31a1b598e9c9c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b31a1b598e9c95 expref: 18 pid: 5836 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740363.790638:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1790740363.790643:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0d87594800/0xc6b31a1b598e9c9c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b31a1b598e9c95 expref: 18 pid: 5836 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740363.790651:0:5829:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790740363.790675:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d87e20380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+16:3303:x1877727158257024:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740363.790681:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790740363.790704:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d87e23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3303:1877727158257152:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790740363.790712:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d87e20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3303:1877727158257024:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790740363.793777:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740363.793806:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740363.794292:0:8506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133056128 00000100:00100000:2.0:1790740363.794301:0:8506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133056128 00010000:00010000:2.0:1790740363.794341:0:8506:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0d9fea6800/0xc6b31a1b598e9cbf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee39e expref: 13 pid: 5836 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740363.794361:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133056256 00000100:00100000:1.0:1790740363.794365:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133056256 00010000:00010000:1.0:1790740363.794383:0:5828:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0d9f976600/0xc6b31a1b598e9c80 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee366 expref: 14 pid: 5837 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740363.794384:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 28 00000100:00100000:2.0:1790740363.794392:0:8506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd7d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+14:2369:x1877727133056128:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790740363.794410:0:8506:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790740363.794425:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 29 00010000:00010000:2.0:1790740363.794428:0:8506:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0d9fea6800/0xc6b31a1b598e9cbf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee39e expref: 14 pid: 5836 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740363.794431:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd7d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+14:2370:x1877727133056256:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790740363.794438:0:5828:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740363.794441:0:8506:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0d9fea6800/0xc6b31a1b598e9cbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee39e expref: 14 pid: 5836 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740363.794442:0:5828:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0d9f976600/0xc6b31a1b598e9c80 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee366 expref: 14 pid: 5837 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740363.794451:0:5828:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0d9f976600/0xc6b31a1b598e9c80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee366 expref: 14 pid: 5837 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740363.795772:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0d9fea6800/0xc6b31a1b598e9cbf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee39e expref: 14 pid: 5836 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740363.795796:0:8506:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790740363.795838:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0d9f976600/0xc6b31a1b598e9c80 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee366 expref: 13 pid: 5837 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740363.795886:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f0d9fea7400/0xc6b31a1b598e9cdb lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740363.795895:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0d9fea7400/0xc6b31a1b598e9cdb lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740363.795912:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f0d9fea7400/0xc6b31a1b598e9cdb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740363.795919:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f0d9fea7400/0xc6b31a1b598e9cdb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740363.795926:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f0d9fea7400/0xc6b31a1b598e9cdb lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740363.795932:0:5828:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f0d9fea7400/0xc6b31a1b598e9cdb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740363.795938:0:5828:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9fea7400 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:1.0:1790740363.795942:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f0d9fea7400/0xc6b31a1b598e9cdb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740363.795950:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f0d9fea7400/0xc6b31a1b598e9cdb lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740363.795972:0:5828:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f0d9fea7400/0xc6b31a1b598e9cdb lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740363.795984:0:5828:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740363.796046:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd7d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+12:2370:x1877727133056256:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 1613us (2237us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740363.796061:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 29 00010000:00010000:0.0:1790740363.797034:0:11164:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f0d9fea7400/0xc6b31a1b598e9cdb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740363.797046:0:11164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f0d9fea7400/0xc6b31a1b598e9cdb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740363.797053:0:11164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0d9fea7400/0xc6b31a1b598e9cdb lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740363.803414:0:8506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd7d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+11:2369:x1877727133056128:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 9010us (9633us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740363.803431:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 28 00010000:00010000:3.0:1790740364.593230:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740364.938539:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740364.938687:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133056384 00000100:00100000:1.0:1790740364.938698:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133056384 00000100:00100000:1.0:1790740364.938757:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 233 00000100:00100000:1.0:1790740364.938774:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+11:5611:x1877727133056384:12345-192.168.203.58@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790740364.938791:0:5835:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740364.938811:0:5835:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0d9f976600/0xc6b31a1b598e9ce2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee3c8 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740364.938840:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0d9f976600/0xc6b31a1b598e9ce2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee3c8 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740364.938852:0:5835:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0d9f976600/0xc6b31a1b598e9ce2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee3c8 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740364.938860:0:5835:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9f976600, rc 0) 00000100:00100000:1.0:1790740364.938922:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+12:5611:x1877727133056384:12345-192.168.203.58@tcp:101:ll_cfg_requeue.0 Request processed in 156us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740364.938929:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 233 00000100:00100000:0.0:1790740364.943197:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740364.943355:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133056512 00000100:00100000:3.0:1790740364.943365:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133056512 00000100:00100000:3.0:1790740364.943420:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 234 00000100:00100000:3.0:1790740364.943429:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+12:5611:x1877727133056512:12345-192.168.203.58@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790740364.943735:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+12:5611:x1877727133056512:12345-192.168.203.58@tcp:501:ll_cfg_requeue.0 Request processed in 306us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740364.943743:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 234 00000100:00100000:0.0:1790740364.946148:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740364.946267:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133056640 00000100:00100000:3.0:1790740364.946275:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133056640 00000100:00100000:3.0:1790740364.946318:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 235 00000100:00100000:3.0:1790740364.946327:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+12:5611:x1877727133056640:12345-192.168.203.58@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790740364.946525:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+12:5611:x1877727133056640:12345-192.168.203.58@tcp:503:ll_cfg_requeue.0 Request processed in 199us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740364.946533:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 235 00000100:00100000:1.0:1790740364.964227:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740364.965005:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133056768 00000100:00100000:3.0:1790740364.965015:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133056768 00000100:00100000:3.0:1790740364.965068:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 236 00000100:00100000:3.0:1790740364.965180:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+12:5611:x1877727133056768:12345-192.168.203.58@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790740364.965196:0:5835:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740364.965214:0:5835:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0d9f499200/0xc6b31a1b598e9ce9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee3cf expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740364.965253:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0d9f499200/0xc6b31a1b598e9ce9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee3cf expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740364.965265:0:5835:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0d9f499200/0xc6b31a1b598e9ce9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee3cf expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740364.965273:0:5835:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9f499200, rc 0) 00000100:00100000:3.0:1790740364.965328:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:5611:x1877727133056768:12345-192.168.203.58@tcp:101:ll_cfg_requeue.0 Request processed in 151us (1110us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740364.967559:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 236 00000100:00100000:0.0:1790740364.967700:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740364.967756:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133056896 00000100:00100000:2.0:1790740364.967765:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133056896 00000100:00100000:2.0:1790740364.967810:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 237 00000100:00100000:2.0:1790740364.967819:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+14:5611:x1877727133056896:12345-192.168.203.58@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790740364.968119:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+14:5611:x1877727133056896:12345-192.168.203.58@tcp:501:ll_cfg_requeue.0 Request processed in 300us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740364.968128:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 237 00000100:00100000:0.0:1790740364.970481:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740364.970558:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133057024 00000100:00100000:3.0:1790740364.970567:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133057024 00000100:00100000:3.0:1790740364.970961:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 238 00000100:00100000:3.0:1790740364.970970:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:5611:x1877727133057024:12345-192.168.203.58@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790740364.971366:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:5611:x1877727133057024:12345-192.168.203.58@tcp:503:ll_cfg_requeue.0 Request processed in 396us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740364.971374:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 238 10000000:01000000:3.0:1790740365.170036:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790740365.170046:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f0db562c800 from 7 10000000:01000000:3.0:1790740365.170052:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790740365.170103:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499800/0xc6b31a1b598e9cf0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740365.170126:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499800/0xc6b31a1b598e9cf0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740365.170137:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499800/0xc6b31a1b598e9cf0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740365.170169:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbee1b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158257280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790740365.170237:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740365.170290:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d87f20300 going to sleep for 11 seconds 00000100:00100000:2.0:1790740365.170343:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158257280 00000100:00100000:2.0:1790740365.170352:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158257280 00000100:00100000:2.0:1790740365.170414:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1790740365.170423:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+16:5841:x1877727158257280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790740365.170437:0:5837:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740365.170450:0:5837:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0d87594000/0xc6b31a1b598e9cf7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b31a1b598e9cf0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740365.170473:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0d87594000/0xc6b31a1b598e9cf7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b31a1b598e9cf0 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740365.170483:0:5837:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0d87594000/0xc6b31a1b598e9cf7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e9cf0 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740365.170498:0:5837:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d87594000, rc 0) 00000100:00100000:2.0:1790740365.170558:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+17:5841:x1877727158257280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740365.170565:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1790740365.170803:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbee1b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158257280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790740365.170819:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499800/0xc6b31a1b598e9cf0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9cf7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740365.170828:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499800/0xc6b31a1b598e9cf0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598e9cf7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740365.170892:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a3ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158257408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790740365.170920:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740365.170957:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0db6ff6540 going to sleep for 11 seconds 00000100:00100000:3.0:1790740365.171148:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158257408 00000100:00100000:3.0:1790740365.171153:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158257408 00000100:00100000:3.0:1790740365.171184:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1790740365.171190:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+17:5841:x1877727158257408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790740365.171416:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+17:5841:x1877727158257408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 226us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740365.171424:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1790740365.172112:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a3ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158257408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790740365.172154:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a3ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158257536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790740365.172195:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740365.172224:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0db6ff6540 going to sleep for 11 seconds 00000100:00100000:3.0:1790740365.174808:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158257536 00000100:00100000:3.0:1790740365.174822:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158257536 00000100:00100000:3.0:1790740365.174879:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1790740365.174888:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+17:5841:x1877727158257536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790740365.175450:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+17:5841:x1877727158257536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 562us (3252us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740365.175458:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1790740365.175502:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a3ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158257536:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790740365.177378:0:11187:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1790740365.179853:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1790740365.179893:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790740365.179906:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499800/0xc6b31a1b598e9cf0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9cf7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740365.179920:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499800/0xc6b31a1b598e9cf0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9cf7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790740365.179942:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790740365.179945:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f0d83fe1000 from 7 10000000:01000000:1.0:1790740365.179948:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790740365.179994:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976000/0xc6b31a1b598e9cfe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740365.180004:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976000/0xc6b31a1b598e9cfe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740365.180015:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976000/0xc6b31a1b598e9cfe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740365.180048:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a3ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158257664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790740365.180114:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740365.180316:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158257664 00000100:00100000:3.0:1790740365.180325:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158257664 00000100:00100000:3.0:1790740365.180369:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1790740365.180379:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+17:5841:x1877727158257664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790740365.180392:0:5836:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740365.180416:0:5836:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0d9f499600/0xc6b31a1b598e9d05 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b31a1b598e9cfe expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740365.180451:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0d9f499600/0xc6b31a1b598e9d05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b31a1b598e9cfe expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740365.180461:0:5836:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0d9f499600/0xc6b31a1b598e9d05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e9cfe expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740365.180469:0:5836:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9f499600, rc 0) 00000100:00100000:3.0:1790740365.180505:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+18:5841:x1877727158257664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740365.180512:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1790740365.180741:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0db6ff6540 going to sleep for 11 seconds 00000100:00100000:1.0:1790740365.180767:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a3ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158257664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790740365.180783:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976000/0xc6b31a1b598e9cfe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9d05 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740365.180792:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976000/0xc6b31a1b598e9cfe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598e9d05 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740365.180847:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a3ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158257792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790740365.180876:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740365.180903:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0db6ff6540 going to sleep for 11 seconds 00000100:00100000:3.0:1790740365.180953:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158257792 00000100:00100000:3.0:1790740365.180957:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158257792 00000100:00100000:3.0:1790740365.180991:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1790740365.180996:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+18:5841:x1877727158257792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790740365.181419:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+18:5841:x1877727158257792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 420us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740365.181426:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1790740365.181564:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a3ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158257792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790740365.181633:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a3ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158257920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790740365.181672:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740365.181687:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0db6ff6540 going to sleep for 11 seconds 00000100:00100000:2.0:1790740365.181769:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158257920 00000100:00100000:2.0:1790740365.181774:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158257920 00000100:00100000:2.0:1790740365.181801:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1790740365.181808:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d874ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+18:5841:x1877727158257920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790740365.181944:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d874ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+18:5841:x1877727158257920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 136us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740365.181951:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1790740365.182306:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a3ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158257920:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790740365.183770:0:11188:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1790740365.184076:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1790740365.184107:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790740365.184119:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976000/0xc6b31a1b598e9cfe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9d05 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740365.184130:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976000/0xc6b31a1b598e9cfe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9d05 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790740365.184241:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790740365.184244:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f0d85311800 from 7 10000000:01000000:1.0:1790740365.184247:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790740365.184283:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977a00/0xc6b31a1b598e9d0c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740365.184292:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977a00/0xc6b31a1b598e9d0c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740365.184301:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977a00/0xc6b31a1b598e9d0c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740365.184322:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a3ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158258048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790740365.184375:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740365.184480:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0db6ff6540 going to sleep for 11 seconds 00000100:00100000:2.0:1790740365.184634:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158258048 00000100:00100000:2.0:1790740365.184642:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158258048 00000100:00100000:2.0:1790740365.184689:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1790740365.184702:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d874af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+18:5841:x1877727158258048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790740365.184716:0:5835:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740365.184729:0:5835:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0d87595000/0xc6b31a1b598e9d13 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b31a1b598e9d0c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740365.184754:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0d87595000/0xc6b31a1b598e9d13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b31a1b598e9d0c expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740365.184765:0:5835:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0d87595000/0xc6b31a1b598e9d13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e9d0c expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740365.184774:0:5835:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d87595000, rc 0) 00000100:00100000:2.0:1790740365.184830:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d874af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:5841:x1877727158258048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740365.184837:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1790740365.185038:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a3ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158258048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790740365.185053:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977a00/0xc6b31a1b598e9d0c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9d13 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740365.185063:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977a00/0xc6b31a1b598e9d0c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598e9d13 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740365.185119:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbee1a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158258176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790740365.185156:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740365.185985:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d87f20300 going to sleep for 11 seconds 00000100:00100000:2.0:1790740365.187670:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158258176 00000100:00100000:2.0:1790740365.187683:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158258176 00000100:00100000:2.0:1790740365.187746:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1790740365.187757:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d874adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:5841:x1877727158258176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790740365.188471:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d874adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:5841:x1877727158258176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 715us (3311us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740365.188481:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1790740365.188629:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbee1a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158258176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790740365.188686:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbee1a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158258304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790740365.188733:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740365.188765:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d87f20300 going to sleep for 11 seconds 00000100:00100000:0.0:1790740365.188824:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158258304 00000100:00100000:0.0:1790740365.188829:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158258304 00000100:00100000:0.0:1790740365.188863:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1790740365.188870:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d874ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:5841:x1877727158258304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790740365.189031:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d874ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:5841:x1877727158258304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 161us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740365.189039:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1790740365.189077:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbee1a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158258304:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1790740365.190133:0:11190:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1790740365.190730:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1790740365.190756:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790740365.190768:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977a00/0xc6b31a1b598e9d0c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9d13 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740365.190780:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977a00/0xc6b31a1b598e9d0c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9d13 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740365.623723:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d87e22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158258688:0@lo:400:kworker.0 00000100:00100000:2.0:1790740365.623793:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740365.623858:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790740365.623864:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d9018fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1877727158258816:0@lo:400:kworker.0 00000100:00100000:2.0:1790740365.623889:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740365.624107:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d87e20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877727158258432:0@lo:400:kworker.0 00000100:00100000:3.0:1790740365.624139:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740365.624170:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d9018ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158258944:0@lo:400:kworker.0 00000100:00100000:3.0:1790740365.624192:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740365.624217:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790740365.624223:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d87e23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1877727158258560:0@lo:400:kworker.0 00000100:00100000:3.0:1790740365.624382:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740365.624419:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158258688 00000100:00100000:3.0:1790740365.624426:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158258688 00000100:00100000:3.0:1790740365.624487:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158258944 00000100:00100000:3.0:1790740365.624491:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158258944 00000100:00100000:3.0:1790740365.624511:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790740365.624521:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d9018c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158258688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740365.624614:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d9018c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158258688:12345-0@lo:400:kworker.0 Request processed in 94us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740365.624622:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790740365.624643:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790740365.624649:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158258944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740365.624693:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158258944:12345-0@lo:400:kworker.0 Request processed in 45us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740365.624699:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790740365.624717:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158258816 00000100:00100000:3.0:1790740365.624721:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158258816 00000100:00100000:3.0:1790740365.624744:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158258432 00000100:00100000:3.0:1790740365.624747:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158258432 00000100:00100000:3.0:1790740365.624756:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158258560 00000100:00100000:3.0:1790740365.624758:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158258560 00000100:00100000:3.0:1790740365.624768:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1790740365.624772:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d9018e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877727158258816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740365.624798:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d9018e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877727158258816:12345-0@lo:400:kworker.0 Request processed in 25us (908us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740365.624803:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1790740365.624812:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1790740365.624816:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877727158258432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740365.624838:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877727158258432:12345-0@lo:400:kworker.0 Request processed in 22us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740365.624842:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1790740365.624852:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1790740365.624856:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877727158258560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740365.624887:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877727158258560:12345-0@lo:400:kworker.0 Request processed in 30us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740365.624892:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:3.0:1790740365.624905:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790740365.624909:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790740365.624911:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790740365.624940:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d87e23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1877727158258560:0@lo:400:kworker.0 00000100:00100000:3.0:1790740365.624949:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d87e20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877727158258432:0@lo:400:kworker.0 00010000:00080000:3.0:1790740365.624958:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0d9018ea00 x1877727158258944/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740365.624968:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d9018ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158258944:0@lo:400:kworker.0 00000100:00100000:2.0:1790740365.625830:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d9018fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1877727158258816:0@lo:400:kworker.0 00010000:00080000:2.0:1790740365.625845:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0d87e22300 x1877727158258688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740365.625854:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d87e22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158258688:0@lo:400:kworker.0 00010000:00010000:2.0:1790740365.630415:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740366.131314:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd7d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158259072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790740366.131381:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740366.131451:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158259072 00000100:00100000:0.0:1790740366.131458:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158259072 00000100:00100000:0.0:1790740366.131508:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790740366.131517:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd7d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877727158259072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790740366.131564:0:6704:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790740366.131621:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd7d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877727158259072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740366.131629:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1790740366.131668:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dbd7d5180 x1877727158259072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740382 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740366.131693:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd7d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158259072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790740366.221365:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740366.221446:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740366.221478:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740366.221543:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133057408 00000100:00100000:3.0:1790740366.221553:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133057408 00000100:00100000:3.0:1790740366.221635:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133057280 00000100:00100000:3.0:1790740366.221638:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133057280 00000100:00100000:3.0:1790740366.221664:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 94 00000100:00100000:3.0:1790740366.221674:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d9018fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+5:2369:x1877727133057408:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:3.0:1790740366.221749:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d9018fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+5:2369:x1877727133057408:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 76us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740366.221756:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 94 00000100:00100000:3.0:1790740366.221777:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 95 00000100:00100000:3.0:1790740366.221782:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d9018ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+6:2369:x1877727133057280:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:3.0:1790740366.221807:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d9018ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+6:2369:x1877727133057280:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 25us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740366.221824:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 95 00000100:00080000:2.0:1790740366.221884:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790740366.222043:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133057152 00000100:00100000:0.0:1790740366.222048:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133057152 00000100:00100000:0.0:1790740366.222093:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 248 00000100:00100000:0.0:1790740366.222101:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d874ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:2369:x1877727133057152:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:0.0:1790740366.222128:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d874ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:2369:x1877727133057152:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 29us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740366.222135:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 248 00000100:00100000:3.0:1790740366.640728:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790740366.640752:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbee18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158259200:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790740366.641108:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740366.642463:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740366.643021:0:6703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158259200 00000100:00100000:1.0:1790740366.643030:0:6703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158259200 00000100:00100000:1.0:1790740366.643086:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1790740366.643096:0:6703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158259200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790740366.643134:0:6703:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790740366.643194:0:6703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158259200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740366.643201:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1790740366.643253:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dbee18380 x1877727158259200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740382 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740366.643273:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbee18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158259200:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790740367.669723:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790740368.062237:0:11362:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1790740368.692245:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740369.714483:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740370.737557:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd7d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1877727158259584:0@lo:400:kworker.0 00000100:00100000:3.0:1790740370.737873:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd7d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877727158259456:0@lo:400:kworker.0 00000100:00100000:3.0:1790740370.737940:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740370.737997:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd7d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158259968:0@lo:400:kworker.0 00000100:00100000:3.0:1790740370.738023:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740370.738081:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158259456 00000100:00100000:3.0:1790740370.738089:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158259456 00000100:00100000:3.0:1790740370.738266:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1790740370.738276:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877727158259456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740370.738336:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877727158259456:12345-0@lo:400:kworker.0 Request processed in 61us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740370.738343:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1790740370.738369:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158259968 00000100:00100000:3.0:1790740370.738373:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158259968 00000100:00100000:3.0:1790740370.738407:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790740370.738414:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158259968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740370.738449:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158259968:12345-0@lo:400:kworker.0 Request processed in 35us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740370.738455:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1790740370.738473:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790740370.738514:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd7d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877727158259456:0@lo:400:kworker.0 00010000:00080000:3.0:1790740370.738544:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dbd7d7100 x1877727158259968/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740370.738555:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd7d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158259968:0@lo:400:kworker.0 00000100:00100000:1.0:1790740370.738741:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd7d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3304:1877727158259328:0@lo:400:kworker.0 00000100:00100000:1.0:1790740370.738778:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740370.738800:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd7d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1877727158259840:0@lo:400:kworker.0 00000100:00100000:1.0:1790740370.738821:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740370.738842:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790740370.738848:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd7d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158259712:0@lo:400:kworker.0 00000100:00100000:1.0:1790740370.738870:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740370.738931:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158259840 00000100:00100000:1.0:1790740370.738936:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158259840 00000100:00100000:2.0:1790740370.739013:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158259328 00000100:00100000:2.0:1790740370.739018:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158259328 00000100:00100000:3.0:1790740370.739811:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158259712 00000100:00100000:3.0:1790740370.739818:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158259712 00000100:00100000:3.0:1790740370.739857:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790740370.739865:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1a3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158259712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740370.739926:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1a3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158259712:12345-0@lo:400:kworker.0 Request processed in 62us (1054us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740370.739932:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:3.0:1790740370.739977:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dbd7d7480 x1877727158259712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740370.739991:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd7d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158259712:0@lo:400:kworker.0 00000100:00080000:3.0:1790740370.740016:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790740370.740020:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790740370.740327:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1790740370.740339:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1a3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1877727158259840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740370.740392:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1a3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1877727158259840:12345-0@lo:400:kworker.0 Request processed in 57us (1570us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740370.740398:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00010000:1.0:1790740370.740418:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740370.740510:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd7d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1877727158259840:0@lo:400:kworker.0 00000100:00100000:2.0:1790740370.740608:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1790740370.740618:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d874ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3304:x1877727158259328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740370.740662:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d874ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3304:x1877727158259328:12345-0@lo:400:kworker.0 Request processed in 47us (1882us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740370.740825:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd7d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3304:1877727158259328:0@lo:400:kworker.0 00000100:00100000:2.0:1790740370.740911:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1790740370.741198:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740370.741332:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158259584 00000100:00100000:3.0:1790740370.741339:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158259584 00000100:00100000:3.0:1790740370.741425:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1790740370.741432:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd7d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877727158259584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740370.741608:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd7d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877727158259584:12345-0@lo:400:kworker.0 Request processed in 176us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740370.741616:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:0.0:1790740370.741830:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790740370.741890:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd7d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1877727158259584:0@lo:400:kworker.0 00000100:00100000:0.0:1790740371.249660:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d9018e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158260096:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790740371.249735:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740371.249797:0:6703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158260096 00000100:00100000:3.0:1790740371.249807:0:6703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158260096 00000100:00100000:3.0:1790740371.249990:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1790740371.250000:0:6703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd7d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877727158260096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790740371.250036:0:6703:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790740371.251034:0:6703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd7d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877727158260096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1033us (1298us total) trans 0 rc 0/0 00010000:00080000:0.0:1790740371.251037:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0d9018e680 x1877727158260096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740387 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740371.251050:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790740371.251066:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d9018e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158260096:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790740371.345743:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740371.345793:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740371.345926:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740371.345979:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133057536 00000100:00100000:3.0:1790740371.345988:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133057536 00000100:00100000:3.0:1790740371.346049:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 250 00000100:00100000:3.0:1790740371.346060:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d874ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:2372:x1877727133057536:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:3.0:1790740371.346205:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d874ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:2372:x1877727133057536:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 148us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740371.346214:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 250 00000100:00100000:1.0:1790740371.348545:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133057664 00000100:00100000:1.0:1790740371.348568:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133057664 00000100:00100000:2.0:1790740371.348688:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133057792 00000100:00100000:2.0:1790740371.348692:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133057792 00000100:00100000:2.0:1790740371.348731:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 99 00000100:00100000:2.0:1790740371.348741:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd7d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+6:2372:x1877727133057664:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:2.0:1790740371.348813:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd7d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+6:2372:x1877727133057664:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 74us (3019us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740371.348820:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 99 00000100:00100000:2.0:1790740371.348836:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 100 00000100:00100000:2.0:1790740371.348842:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd7d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+5:2371:x1877727133057792:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:2.0:1790740371.348863:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd7d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+5:2371:x1877727133057792:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 22us (2937us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740371.348869:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 100 00000100:00080000:3.0:1790740371.349327:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790740371.761695:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740371.761815:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790740371.761836:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d9018f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158260224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790740371.761905:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740371.761964:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158260224 00000100:00100000:2.0:1790740371.761971:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158260224 00000100:00100000:2.0:1790740371.762016:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790740371.762038:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d9018e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158260224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790740371.762354:0:6704:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790740371.762412:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d9018e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158260224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 376us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740371.762420:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1790740371.762510:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0d9018f100 x1877727158260224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740387 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740371.762530:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d9018f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158260224:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1790740372.097161:0:11461:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 23:52:50 (1790740370) === 00000100:00100000:3.0:1790740372.471773:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740372.471834:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740372.471981:0:5851:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133058048 00000100:00100000:0.0:1790740372.471993:0:5851:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133058048 00000100:00100000:0.0:1790740372.472063:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 0 00000100:00100000:0.0:1790740372.472074:0:5851:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ec599375-3198-45fd-a23a-c5620f07177c+6:9684:x1877727133058048:12345-192.168.203.58@tcp:700:mkdir.0 00000100:00100000:0.0:1790740372.472168:0:5851:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ec599375-3198-45fd-a23a-c5620f07177c+6:9684:x1877727133058048:12345-192.168.203.58@tcp:700:mkdir.0 Request processed in 96us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740372.472177:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 0 00000100:00100000:2.0:1790740372.473142:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133057920 00000100:00100000:2.0:1790740372.473151:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133057920 00000100:00100000:2.0:1790740372.473305:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 14 00000100:00100000:2.0:1790740372.473315:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+6:2370:x1877727133057920:12345-192.168.203.58@tcp:41:mkdir.0 00000004:00000024:2.0:1790740372.473361:0:5844:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1790740372.473444:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+6:2370:x1877727133057920:12345-192.168.203.58@tcp:41:mkdir.0 Request processed in 131us (1680us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740372.473452:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 14 00000100:00100000:3.0:1790740372.475700:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740372.476922:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133058304 00000100:00100000:1.0:1790740372.476935:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133058304 00000100:00100000:1.0:1790740372.476994:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 15 00000100:00100000:1.0:1790740372.477004:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+6:9684:x1877727133058304:12345-192.168.203.58@tcp:36:mkdir.0 00010000:00010000:1.0:1790740372.477074:0:5842:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740372.477162:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6600/0xc6b31a1b598e9bfb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee351 expref: 6 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.477298:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0d84bf8a00) 00010000:00010000:1.0:1790740372.477312:0:5842:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790740372.477957:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976a00/0xc6b31a1b598e9d1a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.477972:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976a00/0xc6b31a1b598e9d1a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.477982:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976a00/0xc6b31a1b598e9d1a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.477995:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976800/0xc6b31a1b598e9d21 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.478001:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976800/0xc6b31a1b598e9d21 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.478007:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976800/0xc6b31a1b598e9d21 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790740372.479758:0:5842:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1790740372.479774:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976a00/0xc6b31a1b598e9d1a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.479783:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976a00/0xc6b31a1b598e9d1a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.479791:0:5842:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976a00/0xc6b31a1b598e9d1a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.479804:0:5842:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f976a00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1790740372.479809:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976a00/0xc6b31a1b598e9d1a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.479894:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976a00/0xc6b31a1b598e9d1a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.479911:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0d84a1e900) 00010000:00010000:1.0:1790740372.479915:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740372.479919:0:5842:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976a00/0xc6b31a1b598e9d1a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.479926:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976a00/0xc6b31a1b598e9d1a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790740372.479950:0:5842:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000860227ed reply state 000000003c50ac27 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976800/0xc6b31a1b598e9d21 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740372.479958:0:5842:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790740372.480292:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+7:9684:x1877727133058304:12345-192.168.203.58@tcp:36:mkdir.0 Request processed in 3286us (4595us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1790740372.480302:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 15 00010000:00010000:3.0:1790740372.489037:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976800/0xc6b31a1b598e9d21 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.489055:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976800/0xc6b31a1b598e9d21 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.489063:0:3289:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976800/0xc6b31a1b598e9d21 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.489070:0:3289:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f976800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1790740372.489087:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976800/0xc6b31a1b598e9d21 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.489096:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976800/0xc6b31a1b598e9d21 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.489125:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8f0d84a1ec00) 00010000:00010000:3.0:1790740372.489132:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740372.489137:0:3289:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976800/0xc6b31a1b598e9d21 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.489143:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976800/0xc6b31a1b598e9d21 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740372.501863:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740372.502522:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133058432 00000100:00100000:1.0:1790740372.502533:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133058432 00000100:00100000:1.0:1790740372.502631:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 16 00000100:00100000:1.0:1790740372.502641:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+6:9687:x1877727133058432:12345-192.168.203.58@tcp:101:chmod.0 00010000:00010000:1.0:1790740372.502661:0:8666:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740372.502682:0:8666:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976a00/0xc6b31a1b598e9d28 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee3d6 expref: -99 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.502766:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598e9d2f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.502780:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598e9d2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.502791:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598e9d2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790740372.502824:0:8666:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790740372.502828:0:8666:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790740372.502866:0:8666:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598e9d2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.502893:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976a00/0xc6b31a1b598e9d28 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee3d6 expref: 8 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.502914:0:8666:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598e9d2f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee3d6 expref: 7 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.502922:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0d84a1e900) 00010000:00010000:1.0:1790740372.502925:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790740372.502929:0:8666:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9f977000, rc 0) 00000100:00100000:1.0:1790740372.502993:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+7:9687:x1877727133058432:12345-192.168.203.58@tcp:101:chmod.0 Request processed in 353us (1139us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740372.503001:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 16 00000100:00100000:0.0:1790740372.507258:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740372.508230:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133058688 00000100:00100000:3.0:1790740372.508243:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133058688 00000100:00100000:3.0:1790740372.508321:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 17 00000100:00100000:3.0:1790740372.508333:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd7d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+7:9687:x1877727133058688:12345-192.168.203.58@tcp:36:chmod.0 00010000:00010000:3.0:1790740372.508449:0:5843:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740372.508475:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598e9d2f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee3d6 expref: 7 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.508509:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0d84a1e900) 00010000:00010000:3.0:1790740372.508521:0:5843:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790740372.508545:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f499400/0xc6b31a1b598e9d36 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.508559:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f499400/0xc6b31a1b598e9d36 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.508620:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f499400/0xc6b31a1b598e9d36 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790740372.510802:0:5843:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000693ce872 reply state 00000000848c395a transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f499400/0xc6b31a1b598e9d36 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740372.512000:0:5843:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1790740372.512029:0:5843:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1790740372.515161:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd7d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+8:9687:x1877727133058688:12345-192.168.203.58@tcp:36:chmod.0 Request processed in 6817us (7900us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1790740372.515174:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 17 00010000:00010000:1.0:1790740372.529608:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f499400/0xc6b31a1b598e9d36 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.529643:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f499400/0xc6b31a1b598e9d36 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.529651:0:3290:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f499400/0xc6b31a1b598e9d36 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.529658:0:3290:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f499400 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1790740372.529663:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f499400/0xc6b31a1b598e9d36 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.529672:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f499400/0xc6b31a1b598e9d36 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.529688:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0d944f6500) 00010000:00010000:1.0:1790740372.529691:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790740372.529696:0:3290:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f499400/0xc6b31a1b598e9d36 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.529702:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f499400/0xc6b31a1b598e9d36 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740372.550846:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740372.551811:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133058816 00000100:00100000:2.0:1790740372.551822:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133058816 00000100:00100000:2.0:1790740372.552198:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 18 00000100:00100000:2.0:1790740372.552210:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd7d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+7:9688:x1877727133058816:12345-192.168.203.58@tcp:101:chown.0 00010000:00010000:2.0:1790740372.552234:0:5844:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740372.552260:0:5844:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598e9d3d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee3dd expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740372.552328:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598e9d44 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740372.552359:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598e9d44 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740372.552372:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598e9d44 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740372.552420:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790740372.552424:0:5844:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790740372.552462:0:5844:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598e9d44 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740372.552498:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598e9d3d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee3dd expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740372.552517:0:5844:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598e9d44 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee3dd expref: 8 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740372.552524:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0d98dcc900) 00010000:00010000:2.0:1790740372.552527:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790740372.552531:0:5844:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d87595e00, rc 0) 00000100:00100000:2.0:1790740372.552781:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd7d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+8:9688:x1877727133058816:12345-192.168.203.58@tcp:101:chown.0 Request processed in 573us (1943us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740372.552789:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 18 00000100:00100000:3.0:1790740372.557501:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740372.560331:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133058944 00000100:00100000:1.0:1790740372.560345:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133058944 00000100:00100000:1.0:1790740372.560836:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 19 00000100:00100000:1.0:1790740372.560846:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1c3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+8:9688:x1877727133058944:12345-192.168.203.58@tcp:101:chown.0 00010000:00010000:1.0:1790740372.560880:0:5842:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740372.560901:0:5842:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976a00/0xc6b31a1b598e9d4b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee3e4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.560969:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598e9d52 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.560996:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598e9d52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.561018:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598e9d52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.561036:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976800/0xc6b31a1b598e9d59 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.561043:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976800/0xc6b31a1b598e9d59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.561050:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976800/0xc6b31a1b598e9d59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.561144:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598e9d60 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.561153:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598e9d60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.561160:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598e9d60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790740372.561770:0:5842:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790740372.561775:0:5842:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790740372.561803:0:5842:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598e9d60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.561815:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598e9d52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.561835:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598e9d52 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.561841:0:5842:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598e9d52 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.561847:0:5842:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f977000 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1790740372.561851:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598e9d52 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.561869:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598e9d52 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.561882:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0d98dcc900) 00010000:00010000:1.0:1790740372.561886:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740372.561891:0:5842:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598e9d52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.561898:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598e9d52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.561916:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976800/0xc6b31a1b598e9d59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.561922:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976800/0xc6b31a1b598e9d59 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.561927:0:5842:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976800/0xc6b31a1b598e9d59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.561932:0:5842:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f976800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1790740372.561941:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976800/0xc6b31a1b598e9d59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.561947:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976800/0xc6b31a1b598e9d59 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.561955:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8f0d84a1ef00) 00010000:00010000:1.0:1790740372.561957:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740372.561960:0:5842:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976800/0xc6b31a1b598e9d59 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.561966:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976800/0xc6b31a1b598e9d59 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.562013:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976a00/0xc6b31a1b598e9d4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee3e4 expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.562029:0:5842:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598e9d60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee3e4 expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.562036:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8f0d84a1eb00) 00010000:00010000:1.0:1790740372.562038:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790740372.562040:0:5842:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9f977800, rc 0) 00000100:00100000:1.0:1790740372.562118:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1c3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+9:9688:x1877727133058944:12345-192.168.203.58@tcp:101:chown.0 Request processed in 1273us (4634us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740372.562125:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 19 00000100:00100000:0.0:1790740372.568727:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740372.568929:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133059200 00000100:00100000:1.0:1790740372.568939:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133059200 00000100:00100000:1.0:1790740372.569003:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 20 00000100:00100000:1.0:1790740372.569014:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd7d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+9:9688:x1877727133059200:12345-192.168.203.58@tcp:36:chown.0 00010000:00010000:1.0:1790740372.569084:0:8666:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740372.569113:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598e9d60 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee3e4 expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.569134:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8f0d84a1eb00) 00010000:00010000:1.0:1790740372.569144:0:8666:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790740372.569170:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976a00/0xc6b31a1b598e9d67 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.569194:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976a00/0xc6b31a1b598e9d67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.569206:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976a00/0xc6b31a1b598e9d67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790740372.664043:0:8666:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000df5ec542 reply state 00000000aa8e0c76 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976a00/0xc6b31a1b598e9d67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740372.664061:0:8666:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1790740372.664077:0:8666:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1790740372.664227:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd7d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+10:9688:x1877727133059200:12345-192.168.203.58@tcp:36:chown.0 Request processed in 95211us (95503us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1790740372.664244:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 20 00000001:00080000:2.0:1790740372.664299:0:5865:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00010000:1.0:1790740372.664334:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976a00/0xc6b31a1b598e9d67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.664344:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976a00/0xc6b31a1b598e9d67 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.664352:0:3289:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976a00/0xc6b31a1b598e9d67 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.664358:0:3289:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f976a00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1790740372.664363:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976a00/0xc6b31a1b598e9d67 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.664371:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976a00/0xc6b31a1b598e9d67 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.664403:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8f0d84a1ef00) 00010000:00010000:1.0:1790740372.664406:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790740372.664411:0:3289:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976a00/0xc6b31a1b598e9d67 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.664417:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976a00/0xc6b31a1b598e9d67 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740372.707082:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740372.707303:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133059328 00000100:00100000:1.0:1790740372.707313:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133059328 00000100:00100000:1.0:1790740372.707377:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 21 00000100:00100000:1.0:1790740372.707388:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd7d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+6:9689:x1877727133059328:12345-192.168.203.58@tcp:101:touch.500 00010000:00010000:1.0:1790740372.707415:0:5842:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740372.707437:0:5842:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976a00/0xc6b31a1b598e9d6e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee3eb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790740372.711732:0:5842:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 4230us 00010000:00010000:3.0:1790740372.731988:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f498600/0xc6b31a1b598e9d75 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.732012:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f498600/0xc6b31a1b598e9d75 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.732023:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f498600/0xc6b31a1b598e9d75 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.732046:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f498200/0xc6b31a1b598e9d7c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.732053:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f498200/0xc6b31a1b598e9d7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.732060:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f498200/0xc6b31a1b598e9d7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.732372:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f499400/0xc6b31a1b598e9d83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.732387:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f499400/0xc6b31a1b598e9d83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.732395:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f499400/0xc6b31a1b598e9d83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790740372.732419:0:5842:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790740372.732422:0:5842:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790740372.732460:0:5842:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f499400/0xc6b31a1b598e9d83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.732471:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f498600/0xc6b31a1b598e9d75 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.732478:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f498600/0xc6b31a1b598e9d75 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.732494:0:5842:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f498600/0xc6b31a1b598e9d75 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.732500:0:5842:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f498600 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1790740372.732503:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f498600/0xc6b31a1b598e9d75 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.732511:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f498600/0xc6b31a1b598e9d75 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.732530:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0d98dcc900) 00010000:00010000:3.0:1790740372.732533:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740372.732538:0:5842:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f498600/0xc6b31a1b598e9d75 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.732552:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f498600/0xc6b31a1b598e9d75 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.732562:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f498200/0xc6b31a1b598e9d7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.732567:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f498200/0xc6b31a1b598e9d7c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.732596:0:5842:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f498200/0xc6b31a1b598e9d7c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.732601:0:5842:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f498200 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1790740372.732604:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f498200/0xc6b31a1b598e9d7c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.732610:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f498200/0xc6b31a1b598e9d7c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.732617:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8f0d944f6900) 00010000:00010000:3.0:1790740372.732620:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740372.732623:0:5842:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f498200/0xc6b31a1b598e9d7c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.732629:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f498200/0xc6b31a1b598e9d7c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.732662:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976a00/0xc6b31a1b598e9d6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee3eb expref: 8 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.732679:0:5842:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f499400/0xc6b31a1b598e9d83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee3eb expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.732693:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8f0d944f6800) 00010000:00010000:3.0:1790740372.732695:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1790740372.732697:0:5842:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9f499400, rc 0) 00000100:00100000:3.0:1790740372.732774:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd7d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+7:9689:x1877727133059328:12345-192.168.203.58@tcp:101:touch.500 Request processed in 25386us (25713us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740372.732783:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 21 00000100:00100000:2.0:1790740372.742990:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740372.743173:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133059584 00000100:00100000:3.0:1790740372.743183:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133059584 00000100:00100000:3.0:1790740372.743239:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 22 00000100:00100000:3.0:1790740372.743249:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d9018ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+7:9689:x1877727133059584:12345-192.168.203.58@tcp:101:touch.500 00010000:00010000:3.0:1790740372.743270:0:5844:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740372.743289:0:5844:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f498600/0xc6b31a1b598e9d8a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee3f2 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.743548:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f498000/0xc6b31a1b598e9d91 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.743564:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f498000/0xc6b31a1b598e9d91 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.743609:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f498000/0xc6b31a1b598e9d91 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.743639:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f400/0xc6b31a1b598e9d98 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.743648:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f400/0xc6b31a1b598e9d98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.743665:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f400/0xc6b31a1b598e9d98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790740372.744526:0:5844:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1790740372.744812:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598e9d9f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.744825:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598e9d9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.744834:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598e9d9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.744864:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f498000/0xc6b31a1b598e9d91 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.744871:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f498000/0xc6b31a1b598e9d91 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.744877:0:5844:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f498000/0xc6b31a1b598e9d91 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.744882:0:5844:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f498000 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1790740372.744887:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f498000/0xc6b31a1b598e9d91 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.744894:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f498000/0xc6b31a1b598e9d91 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.747349:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8f0d944f6800) 00010000:00010000:3.0:1790740372.747359:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740372.747387:0:5844:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f498000/0xc6b31a1b598e9d91 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.747397:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f498000/0xc6b31a1b598e9d91 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790740372.747415:0:5844:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000bcd0414d reply state 00000000cfee02e4 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f400/0xc6b31a1b598e9d98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740372.747426:0:5844:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1790740372.747695:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f498600/0xc6b31a1b598e9d8a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee3f2 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740372.747712:0:5844:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598e9d9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee3f2 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740372.747720:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8f0d944f6c00) 00010000:00010000:2.0:1790740372.747722:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790740372.747725:0:5844:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0db6c0e600, rc 0) 00000100:00100000:2.0:1790740372.747801:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d9018ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+10:9689:x1877727133059584:12345-192.168.203.58@tcp:101:touch.500 Request processed in 4553us (4819us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1790740372.747809:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 22 00010000:00010000:1.0:1790740372.759694:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f400/0xc6b31a1b598e9d98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.759713:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f400/0xc6b31a1b598e9d98 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.759722:0:3289:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f400/0xc6b31a1b598e9d98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.759728:0:3289:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0f400 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1790740372.759733:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f400/0xc6b31a1b598e9d98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.759753:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f400/0xc6b31a1b598e9d98 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.759769:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xbcdd3602 (ffff8f0d944f6b00) 00010000:00010000:1.0:1790740372.759772:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740372.759777:0:3289:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f400/0xc6b31a1b598e9d98 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.759782:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f400/0xc6b31a1b598e9d98 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740372.781055:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740372.781200:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133059840 00000100:00100000:3.0:1790740372.781210:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133059840 00000100:00100000:3.0:1790740372.781280:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 23 00000100:00100000:3.0:1790740372.781290:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d9018f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+9:9689:x1877727133059840:12345-192.168.203.58@tcp:36:touch.500 00010000:00010000:3.0:1790740372.781350:0:5843:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740372.781377:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598e9d9f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee3f2 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.781396:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8f0d944f6c00) 00010000:00010000:3.0:1790740372.781407:0:5843:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790740372.781858:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598e9dad lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740372.781872:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598e9dad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740372.781883:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598e9dad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790740372.782045:0:5843:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000a1485fed reply state 0000000066da7b63 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598e9dad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740372.782054:0:5843:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790740372.782146:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d9018f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+10:9689:x1877727133059840:12345-192.168.203.58@tcp:36:touch.500 Request processed in 856us (1098us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1790740372.782153:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 23 00010000:00010000:1.0:1790740372.784705:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740372.785936:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00010000:00010000:1.0:1790740372.786102:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598e9dad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.786117:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598e9dad lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.786126:0:3290:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598e9dad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.786133:0:3290:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87594200 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1790740372.786139:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598e9dad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.786148:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598e9dad lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.786165:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8f0d98dcce00) 00010000:00010000:1.0:1790740372.786169:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740372.786182:0:3290:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598e9dad lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740372.786189:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598e9dad lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740372.787118:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133059968 00000100:00100000:3.0:1790740372.787130:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133059968 00000100:00100000:3.0:1790740372.787191:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 24 00000100:00100000:3.0:1790740372.787202:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d87e20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+9:9689:x1877727133059968:12345-192.168.203.58@tcp:101:touch.500 00010000:00010000:3.0:1790740372.787225:0:8666:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740372.787256:0:8666:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598e9db4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee3f9 expref: -99 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.787317:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598e9db4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee3f9 expref: 10 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.787343:0:8666:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598e9db4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee3f9 expref: 10 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.787365:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8f0d944f6c00) 00010000:00010000:3.0:1790740372.787368:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790740372.787371:0:8666:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0db6c0e600, rc 0) 00000100:00100000:3.0:1790740372.787560:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d87e20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+10:9689:x1877727133059968:12345-192.168.203.58@tcp:101:touch.500 Request processed in 227us (1508us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740372.787568:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 24 00000100:00100000:0.0:1790740372.793720:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740372.794029:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133060096 00000100:00100000:3.0:1790740372.794041:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133060096 00000100:00100000:3.0:1790740372.794097:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 16 00000100:00100000:3.0:1790740372.794106:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd7d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2368:x1877727133060096:12345-192.168.203.58@tcp:8:touch.500 00010000:00080000:3.0:1790740372.794146:0:6701:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from ec599375-3198-45fd-a23a-c5620f07177c@192.168.203.58@tcp t0 exp 0000000000000000 cur 288 last 0 00000020:00000080:3.0:1790740372.794185:0:6701:0:(genops.c:1384:class_connect()) connect: client ec599375-3198-45fd-a23a-c5620f07177c, cookie 0xc6b31a1b598e9dbb 00002000:00100000:3.0:1790740372.794198:0:6701:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ec599375-3198-45fd-a23a-c5620f07177c/ffff8f0d83f25800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b03 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1790740372.794210:0:6701:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1790740372.794464:0:6701:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1790740372.794510:0:6701:0:(import.c:65:import_set_state_nolock()) ffff8f0d83f22000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790740372.794821:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd7d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec599375-3198-45fd-a23a-c5620f07177c+6:2368:x1877727133060096:12345-192.168.203.58@tcp:8:touch.500 Request processed in 713us (1110us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740372.794830:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 16 00000100:00100000:0.0:1790740372.798881:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740372.799024:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133060224 00000100:00100000:3.0:1790740372.799039:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133060224 00000100:00100000:3.0:1790740372.799122:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 17 00000100:00100000:3.0:1790740372.799131:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd7d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec599375-3198-45fd-a23a-c5620f07177c+6:0:x1877727133060224:12345-192.168.203.58@tcp:2:touch.500 00000100:00080000:0.0:1790740372.799539:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1790740372.906349:0:7642:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:0.0:1790740372.906366:0:7642:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ec599375-3198-45fd-a23a-c5620f07177c 00000100:00100000:3.0:1790740372.906561:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd7d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec599375-3198-45fd-a23a-c5620f07177c+5:0:x1877727133060224:12345-192.168.203.58@tcp:2:touch.500 Request processed in 107425us (107682us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1790740372.907021:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 17 00000100:00100000:2.0:1790740372.912095:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740372.912848:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133060480 00000100:00100000:3.0:1790740372.912860:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133060480 00000100:00100000:3.0:1790740372.912909:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 2 00000100:00100000:3.0:1790740372.912919:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d87e23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec599375-3198-45fd-a23a-c5620f07177c+10:9689:x1877727133060480:12345-192.168.203.58@tcp:35:touch.500 00000100:00100000:3.0:1790740372.913381:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d87e23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec599375-3198-45fd-a23a-c5620f07177c+11:9689:x1877727133060480:12345-192.168.203.58@tcp:35:touch.500 Request processed in 462us (1294us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1790740372.913388:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 2 00000100:00100000:0.0:1790740372.934883:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740372.937123:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133060608 00000100:00100000:1.0:1790740372.937137:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133060608 00000100:00100000:1.0:1790740372.937209:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 25 00000100:00100000:1.0:1790740372.937219:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db5a6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+11:9690:x1877727133060608:12345-192.168.203.58@tcp:101:rm.0 00010000:00010000:2.0:1790740372.937724:0:5842:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740372.937748:0:5842:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598e9dc2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee400 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740372.937815:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595200/0xc6b31a1b598e9dc9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740372.937831:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595200/0xc6b31a1b598e9dc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740372.937842:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595200/0xc6b31a1b598e9dc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740372.937874:0:5842:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790740372.937878:0:5842:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790740372.937914:0:5842:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595200/0xc6b31a1b598e9dc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740372.937937:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598e9dc2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee400 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740372.937954:0:5842:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595200/0xc6b31a1b598e9dc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee400 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740372.937973:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8f0d944f6800) 00010000:00010000:2.0:1790740372.937976:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790740372.937979:0:5842:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d87595200, rc 0) 00000100:00100000:2.0:1790740372.938165:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db5a6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+12:9690:x1877727133060608:12345-192.168.203.58@tcp:101:rm.0 Request processed in 947us (3290us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740372.938187:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 25 00000100:00100000:0.0:1790740372.943132:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740372.943626:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133060864 00000100:00100000:3.0:1790740372.943636:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133060864 00000100:00100000:3.0:1790740372.943698:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 26 00000100:00100000:3.0:1790740372.943709:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+12:9690:x1877727133060864:12345-192.168.203.58@tcp:101:rm.0 00010000:00010000:3.0:1790740372.943730:0:8666:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740372.943751:0:8666:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ec00/0xc6b31a1b598e9dd0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee407 expref: -99 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790740372.943839:0:8666:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1790740372.943989:0:8666:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ec00/0xc6b31a1b598e9dd0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee407 expref: 14 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.944003:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0d98dcc900) 00010000:00010000:3.0:1790740372.944006:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790740372.944017:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ec00/0xc6b31a1b598e9dd0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee407 expref: 14 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740372.944031:0:8666:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0db6c0ec00, rc 0) 00000100:00100000:3.0:1790740372.944091:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+13:9690:x1877727133060864:12345-192.168.203.58@tcp:101:rm.0 Request processed in 384us (967us total) trans 4294967303 rc 301/301 00000100:00100000:3.0:1790740372.944099:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 26 00000100:00100000:3.0:1790740372.947982:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740372.948187:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133060992 00000100:00100000:0.0:1790740372.948198:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133060992 00000100:00100000:0.0:1790740372.948266:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 3 00000100:00100000:0.0:1790740372.948276:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8654b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+13:9690:x1877727133060992:12345-192.168.203.58@tcp:37:rm.0 00000100:00100000:2.0:1790740372.960934:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8654b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+13:9690:x1877727133060992:12345-192.168.203.58@tcp:37:rm.0 Request processed in 12649us (12950us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740372.960948:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 3 00000100:00100000:2.0:1790740372.970392:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740372.975354:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133061248 00000100:00100000:3.0:1790740372.975369:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133061248 00000100:00100000:3.0:1790740372.975494:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 4 00000100:00100000:3.0:1790740372.975505:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0da203a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec599375-3198-45fd-a23a-c5620f07177c+13:9690:x1877727133061248:12345-192.168.203.58@tcp:35:rm.0 00000100:00100000:3.0:1790740372.977536:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0da203a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec599375-3198-45fd-a23a-c5620f07177c+14:9690:x1877727133061248:12345-192.168.203.58@tcp:35:rm.0 Request processed in 2026us (7144us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1790740372.977548:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 4 00000100:00100000:0.0:1790740372.997114:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740372.997204:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133061504 00000100:00100000:2.0:1790740372.997216:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133061504 00000100:00100000:2.0:1790740372.997315:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 27 00000100:00100000:2.0:1790740372.997326:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+14:9690:x1877727133061504:12345-192.168.203.58@tcp:101:rm.0 00010000:00010000:2.0:1790740372.997348:0:5843:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740372.997368:0:5843:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598e9dde lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee40e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740372.997461:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598e9de5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740372.997476:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598e9de5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740372.997497:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598e9de5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740372.997509:0:5843:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1790740372.997674:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598e9dde lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee40e expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740372.997693:0:5843:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598e9de5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee40e expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740372.997732:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8f0d944f6800) 00010000:00010000:2.0:1790740372.997735:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790740372.997739:0:5843:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d87595800, rc 0) 00000100:00100000:2.0:1790740372.997791:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+16:9690:x1877727133061504:12345-192.168.203.58@tcp:101:rm.0 Request processed in 468us (687us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1790740372.997799:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 27 00000100:00100000:0.0:1790740373.002391:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740373.002492:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133061632 00000100:00100000:1.0:1790740373.002502:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133061632 00000100:00100000:1.0:1790740373.002598:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 28 00000100:00100000:1.0:1790740373.002618:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+16:9690:x1877727133061632:12345-192.168.203.58@tcp:41:rm.0 00000004:00000024:1.0:1790740373.002676:0:5844:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:1.0:1790740373.002741:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+16:9690:x1877727133061632:12345-192.168.203.58@tcp:41:rm.0 Request processed in 134us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740373.002749:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 28 00000100:00080000:0.0:1790740373.003311:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790740373.012904:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740373.013041:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133061760 00000100:00100000:3.0:1790740373.013051:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133061760 00000100:00100000:3.0:1790740373.013102:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 29 00000100:00100000:3.0:1790740373.013111:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+16:9690:x1877727133061760:12345-192.168.203.58@tcp:101:rm.0 00010000:00010000:3.0:1790740373.013129:0:5842:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740373.013148:0:5842:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ec00/0xc6b31a1b598e9df3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee415 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.013208:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ea00/0xc6b31a1b598e9dfa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.013221:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ea00/0xc6b31a1b598e9dfa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.013396:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ea00/0xc6b31a1b598e9dfa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.013412:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f200/0xc6b31a1b598e9e01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.013420:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f200/0xc6b31a1b598e9e01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.013426:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f200/0xc6b31a1b598e9e01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.013522:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598e9e08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.013530:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598e9e08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.013536:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598e9e08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790740373.013560:0:5842:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1790740373.013565:0:5842:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790740373.023419:0:5842:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598e9e08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.023449:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598e9e08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.023476:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ea00/0xc6b31a1b598e9dfa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.023491:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ea00/0xc6b31a1b598e9dfa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.023499:0:5842:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ea00/0xc6b31a1b598e9dfa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.023506:0:5842:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0ea00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1790740373.023511:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ea00/0xc6b31a1b598e9dfa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.023518:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ea00/0xc6b31a1b598e9dfa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.023535:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8f0d944f6800) 00010000:00010000:0.0:1790740373.023539:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740373.023543:0:5842:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ea00/0xc6b31a1b598e9dfa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.023549:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ea00/0xc6b31a1b598e9dfa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.023565:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f200/0xc6b31a1b598e9e01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.023604:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f200/0xc6b31a1b598e9e01 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.023940:0:5842:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f200/0xc6b31a1b598e9e01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.023953:0:5842:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0f200 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1790740373.023957:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f200/0xc6b31a1b598e9e01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.023962:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f200/0xc6b31a1b598e9e01 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.023971:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xbcdd3602 (ffff8f0d944f6000) 00010000:00010000:0.0:1790740373.023974:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740373.023977:0:5842:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f200/0xc6b31a1b598e9e01 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.023983:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f200/0xc6b31a1b598e9e01 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.024032:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ec00/0xc6b31a1b598e9df3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee415 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.024047:0:5842:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598e9e08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee415 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740373.024055:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8f0d944f6c00) 00010000:00010000:0.0:1790740373.024058:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790740373.024061:0:5842:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0db6c0f600, rc 0) 00000100:00100000:0.0:1790740373.024139:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+17:9690:x1877727133061760:12345-192.168.203.58@tcp:101:rm.0 Request processed in 11027us (11242us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740373.024148:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 29 00000100:00100000:0.0:1790740373.035987:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740373.036105:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133062016 00000100:00100000:3.0:1790740373.036125:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133062016 00000100:00100000:3.0:1790740373.036183:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 30 00000100:00100000:3.0:1790740373.036194:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+17:9690:x1877727133062016:12345-192.168.203.58@tcp:36:rm.0 00010000:00010000:3.0:1790740373.036252:0:8666:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1790740373.036279:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598e9e08 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee415 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.036314:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598e9db4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee3f9 expref: 16 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.036324:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8f0d944f6c00) 00010000:00010000:3.0:1790740373.036340:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595200/0xc6b31a1b598e9dc9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee400 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.036348:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8f0d944f6800) 00010000:00010000:3.0:1790740373.036352:0:8666:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790740373.036373:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f800/0xc6b31a1b598e9e0f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.036386:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f800/0xc6b31a1b598e9e0f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.036398:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f800/0xc6b31a1b598e9e0f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.036412:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e200/0xc6b31a1b598e9e16 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.036418:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e200/0xc6b31a1b598e9e16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.036425:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e200/0xc6b31a1b598e9e16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.036535:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598e9e1d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.036554:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598e9e1d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.036561:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598e9e1d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790740373.038211:0:8666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1790740373.038225:0:8666:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 288988651622ns, next at 289988648888ns, rc = 0 00010000:00010000:2.0:1790740373.038430:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598e9e24 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740373.038446:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598e9e24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740373.038458:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598e9e24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740373.038466:0:8666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598e9e24 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740373.038472:0:8666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598e9e24 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740373.038478:0:8666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598e9e24 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740373.038513:0:8666:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790740373.038535:0:8666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598e9e1d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740373.038554:0:8666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598e9e1d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740373.038560:0:8666:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598e9e1d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740373.038565:0:8666:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0f000 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740373.038569:0:8666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598e9e1d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740373.038605:0:8666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598e9e1d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740373.038952:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8f0d944f6200) 00010000:00010000:2.0:1790740373.038955:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1790740373.038960:0:8666:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598e9e1d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740373.038965:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598e9e1d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740373.038985:0:8666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f800/0xc6b31a1b598e9e0f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740373.038990:0:8666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f800/0xc6b31a1b598e9e0f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740373.038996:0:8666:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f800/0xc6b31a1b598e9e0f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740373.039000:0:8666:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0f800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740373.039227:0:8666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f800/0xc6b31a1b598e9e0f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.039297:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740373.039305:0:5832:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598e9e24 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.039313:0:5832:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87594a00 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:3.0:1790740373.039317:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598e9e24 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.039324:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598e9e24 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.039333:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8f0d944f6200) 00010000:00010000:3.0:1790740373.039336:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1790740373.039339:0:5832:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598e9e24 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.039344:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598e9e24 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740373.039361:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740373.039363:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740373.039364:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740373.039452:0:8666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f800/0xc6b31a1b598e9e0f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740373.039462:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8f0d944f6800) 00010000:00010000:2.0:1790740373.039465:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740373.039468:0:8666:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f800/0xc6b31a1b598e9e0f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740373.039476:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f800/0xc6b31a1b598e9e0f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790740373.039497:0:8666:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000005a98bd60 reply state 000000003416911a transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e200/0xc6b31a1b598e9e16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740373.039505:0:8666:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790740373.040523:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+16:9690:x1877727133062016:12345-192.168.203.58@tcp:36:rm.0 Request processed in 4324us (4537us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1790740373.040534:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 30 00010000:00010000:1.0:1790740373.046988:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e200/0xc6b31a1b598e9e16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.047093:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e200/0xc6b31a1b598e9e16 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.047102:0:3289:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e200/0xc6b31a1b598e9e16 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.047109:0:3289:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0e200 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1790740373.047114:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e200/0xc6b31a1b598e9e16 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.047140:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e200/0xc6b31a1b598e9e16 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.047156:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xbcdd3602 (ffff8f0d944f6900) 00010000:00010000:1.0:1790740373.047159:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740373.047164:0:3289:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e200/0xc6b31a1b598e9e16 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.047169:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e200/0xc6b31a1b598e9e16 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740373.048507:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740373.050453:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133062272 00000100:00100000:2.0:1790740373.050468:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133062272 00000100:00100000:2.0:1790740373.050544:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 5 00000100:00100000:2.0:1790740373.050555:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+15:9690:x1877727133062272:12345-192.168.203.58@tcp:35:rm.0 00000100:00100000:2.0:1790740373.051139:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+16:9690:x1877727133062272:12345-192.168.203.58@tcp:35:rm.0 Request processed in 584us (2638us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1790740373.051147:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 5 00000100:00100000:3.0:1790740373.054815:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740373.054888:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133062528 00000100:00100000:1.0:1790740373.054903:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133062528 00000100:00100000:1.0:1790740373.055140:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 31 00000100:00100000:1.0:1790740373.055152:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8654b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+16:9690:x1877727133062528:12345-192.168.203.58@tcp:36:rm.0 00010000:00010000:1.0:1790740373.055213:0:5844:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1790740373.060675:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598e9de5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee40e expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.060714:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f499400/0xc6b31a1b598e9d83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee3eb expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.060726:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8f0d944f6800) 00010000:00010000:1.0:1790740373.060745:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598e9d44 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee3dd expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.060754:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0d98dcc900) 00010000:00010000:1.0:1790740373.060781:0:5844:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790740373.060812:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598e9e2b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.060826:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598e9e2b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.060837:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598e9e2b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.060850:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976800/0xc6b31a1b598e9e32 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.060858:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976800/0xc6b31a1b598e9e32 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.060864:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976800/0xc6b31a1b598e9e32 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.061094:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598e9e39 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.061102:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598e9e39 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.061109:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598e9e39 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790740373.061693:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1790740373.061710:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598e9e39 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.061718:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598e9e39 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.061731:0:5844:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598e9e39 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.061737:0:5844:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f977000 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1790740373.061741:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598e9e39 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.061749:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598e9e39 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.061758:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8f0d84a1ed00) 00010000:00010000:1.0:1790740373.061761:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1790740373.061765:0:5844:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598e9e39 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.061771:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598e9e39 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.061796:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598e9e2b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.061801:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598e9e2b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.061806:0:5844:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598e9e2b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.061811:0:5844:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f977800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1790740373.061814:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598e9e2b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.061830:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598e9e2b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.061838:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0d84a1ef00) 00010000:00010000:1.0:1790740373.061841:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740373.061843:0:5844:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598e9e2b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.061849:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598e9e2b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790740373.061862:0:5844:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000cd26b57d reply state 000000001bad1442 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976800/0xc6b31a1b598e9e32 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740373.061870:0:5844:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790740373.061963:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8654b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+15:9690:x1877727133062528:12345-192.168.203.58@tcp:36:rm.0 Request processed in 6810us (7157us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1790740373.061972:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 31 00010000:00010000:1.0:1790740373.070373:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976800/0xc6b31a1b598e9e32 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.070389:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976800/0xc6b31a1b598e9e32 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.070397:0:3290:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976800/0xc6b31a1b598e9e32 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.070403:0:3290:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f976800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1790740373.070408:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976800/0xc6b31a1b598e9e32 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.070434:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976800/0xc6b31a1b598e9e32 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.070450:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8f0d84a1eb00) 00010000:00010000:1.0:1790740373.070453:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740373.070457:0:3290:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976800/0xc6b31a1b598e9e32 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.070463:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976800/0xc6b31a1b598e9e32 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740373.809466:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740374.832788:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740375.856878:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740375.857773:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877727158260480:0@lo:400:kworker.0 00000100:00100000:0.0:1790740375.857848:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740375.857892:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158260992:0@lo:400:kworker.0 00000100:00100000:0.0:1790740375.857917:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740375.857946:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790740375.857951:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1877727158260608:0@lo:400:kworker.0 00000100:00100000:0.0:1790740375.857972:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740375.858013:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158260480 00000100:00100000:0.0:1790740375.858020:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158260480 00000100:00100000:0.0:1790740375.858061:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158260608 00000100:00100000:0.0:1790740375.858063:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158260608 00000100:00100000:0.0:1790740375.858087:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1790740375.858096:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877727158260480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740375.858144:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877727158260480:12345-0@lo:400:kworker.0 Request processed in 49us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740375.858151:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1790740375.858169:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1790740375.858174:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877727158260608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740375.858199:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877727158260608:12345-0@lo:400:kworker.0 Request processed in 26us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740375.858205:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1790740375.858222:0:8460:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158260992 00000100:00100000:0.0:1790740375.858226:0:8460:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158260992 00000100:00100000:0.0:1790740375.858251:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1790740375.858257:0:8460:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158260992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740375.858285:0:8460:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158260992:12345-0@lo:400:kworker.0 Request processed in 28us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740375.858299:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1790740375.858321:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790740375.858326:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790740375.858404:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1877727158260608:0@lo:400:kworker.0 00000100:00100000:0.0:1790740375.858415:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877727158260480:0@lo:400:kworker.0 00010000:00080000:0.0:1790740375.858426:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dbda71180 x1877727158260992/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740391 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740375.858436:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158260992:0@lo:400:kworker.0 00000100:00100000:1.0:1790740375.858560:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3304:1877727158260352:0@lo:400:kworker.0 00000100:00100000:1.0:1790740375.858630:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740375.858656:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1877727158260864:0@lo:400:kworker.0 00000100:00100000:1.0:1790740375.858675:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740375.858690:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790740375.858695:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158260736:0@lo:400:kworker.0 00000100:00100000:1.0:1790740375.858716:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740375.858740:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158260864 00000100:00100000:1.0:1790740375.858744:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158260864 00000100:00100000:1.0:1790740375.858770:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1790740375.858776:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1877727158260864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740375.858810:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1877727158260864:12345-0@lo:400:kworker.0 Request processed in 34us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740375.858816:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1790740375.858841:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158260736 00000100:00100000:1.0:1790740375.858845:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158260736 00000100:00100000:1.0:1790740375.858869:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1790740375.858875:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1a3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158260736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740375.858904:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1a3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158260736:12345-0@lo:400:kworker.0 Request processed in 30us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740375.858910:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:1.0:1790740375.858933:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dbda71880 x1877727158260736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740391 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740375.858942:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158260736:0@lo:400:kworker.0 00000100:00100000:1.0:1790740375.858950:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1877727158260864:0@lo:400:kworker.0 00000100:00100000:0.0:1790740375.859021:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158260352 00000100:00100000:0.0:1790740375.859025:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158260352 00000100:00100000:0.0:1790740375.859180:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1790740375.859188:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d874af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3304:x1877727158260352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740375.859233:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d874af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3304:x1877727158260352:12345-0@lo:400:kworker.0 Request processed in 46us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740375.859239:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1790740375.859291:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3304:1877727158260352:0@lo:400:kworker.0 00000100:00080000:1.0:1790740375.860682:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790740375.860690:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790740376.369236:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000004:00080000:2.0:1790740376.369728:0:8152:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 292320154136ns, next at 293320152219ns, rc = 0 00000100:00100000:3.0:1790740376.377962:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d87e22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158261120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790740376.378040:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740376.381919:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158261120 00000100:00100000:1.0:1790740376.381934:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158261120 00000100:00100000:1.0:1790740376.382059:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790740376.382071:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8654ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158261120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790740376.382117:0:6704:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790740376.382203:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8654ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158261120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 135us (4163us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740376.382211:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1790740376.382292:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0d87e22300 x1877727158261120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740392 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740376.382312:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d87e22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158261120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790740376.469157:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740376.469201:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740376.469234:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740376.469271:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740376.469302:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133062784 00000100:00100000:3.0:1790740376.469311:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133062784 00000100:00100000:1.0:1790740376.469371:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133063040 00000100:00100000:3.0:1790740376.469376:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 104 00000100:00100000:1.0:1790740376.469378:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133063040 00000100:00100000:3.0:1790740376.469388:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8654b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+14:2370:x1877727133062784:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:1.0:1790740376.469414:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 105 00000100:00100000:1.0:1790740376.469423:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8654bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+5:2370:x1877727133063040:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:0.0:1790740376.469518:0:8460:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133062912 00000100:00100000:0.0:1790740376.469522:0:8460:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133062912 00000100:00100000:0.0:1790740376.469553:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 58 00000100:00100000:0.0:1790740376.469560:0:8460:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8654a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec599375-3198-45fd-a23a-c5620f07177c+5:2370:x1877727133062912:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:2.0:1790740376.469663:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133062656 00000100:00100000:2.0:1790740376.469668:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133062656 00000100:00100000:2.0:1790740376.469696:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 252 00000100:00100000:2.0:1790740376.469703:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d874ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:2370:x1877727133062656:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:3.0:1790740376.470414:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8654b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+14:2370:x1877727133062784:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 1026us (1176us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740376.470423:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 104 00000100:00100000:1.0:1790740376.471782:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8654bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+5:2370:x1877727133063040:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 2353us (2503us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740376.471809:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 105 00000100:00080000:1.0:1790740376.471844:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790740376.471849:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790740376.473107:0:8460:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8654a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec599375-3198-45fd-a23a-c5620f07177c+5:2370:x1877727133062912:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 3540us (3897us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740376.473119:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 58 00000100:00100000:2.0:1790740376.473311:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d874ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:2370:x1877727133062656:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 3604us (4160us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740376.473322:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 252 00000100:00100000:3.0:1790740376.880870:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790740376.880893:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d8654a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158261248:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790740376.881052:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740376.881121:0:6703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158261248 00000100:00100000:3.0:1790740376.881129:0:6703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158261248 00000100:00100000:3.0:1790740376.881177:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1790740376.881187:0:6703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d86548380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158261248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790740376.881223:0:6703:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790740376.881504:0:6703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d86548380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158261248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 317us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740376.881525:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:3.0:1790740376.881614:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0d8654a300 x1877727158261248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740392 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740376.881637:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d8654a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158261248:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790740376.882174:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790740377.427994:0:11610:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:1.0:1790740377.904772:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1790740378.005921:0:5865:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:3.0:1790740378.005941:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000004:00080000:3.0:1790740378.005967:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:2.0:1790740378.006207:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790740378.006229:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158261376:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1790740378.006297:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740378.006410:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158261376 00000100:00100000:1.0:1790740378.006419:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158261376 00000100:00100000:1.0:1790740378.006492:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790740378.006503:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d87e22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158261376:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1790740378.006527:0:6700:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1790740378.006558:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6abc8794, atime: 0x6abc8794, ctime: 0x6abc8794, blocks: 0x1 00010000:00010000:1.0:1790740378.006566:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000198e6232/0xc6b31a1b598e9e40 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740378.006623:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=293s v=(0 0) 00010000:00010000:1.0:1790740378.006627:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790740378.006633:0:6700:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000198e6232/0xc6b31a1b598e9e40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740378.006650:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000198e6232/0xc6b31a1b598e9e40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740378.006661:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000198e6232/0xc6b31a1b598e9e40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740378.006669:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000198e6232/0xc6b31a1b598e9e40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740378.006700:0:6700:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1790740378.007403:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d87e22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1877727158261376:12345-0@lo:6:osp-syn-1-0.0 Request processed in 899us (1102us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1790740378.007412:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1790740378.007506:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740378.007513:0:5832:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000198e6232/0xc6b31a1b598e9e40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740378.007523:0:5832:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f976800 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:3.0:1790740378.007527:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000198e6232/0xc6b31a1b598e9e40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740378.007537:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000198e6232/0xc6b31a1b598e9e40 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740378.007556:0:5832:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000198e6232/0xc6b31a1b598e9e40 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740378.007563:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000198e6232/0xc6b31a1b598e9e40 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740378.007630:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740378.007632:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740378.007633:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790740378.007713:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1790740378.007757:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f0dbda71180/2, rc 0, transno 4294967300 00000100:00100000:2.0:1790740378.007764:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158261376:0@lo:6:osp-syn-1-0.0 00000020:00000080:3.0:1790740378.862334:0:11659:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe98fe7af0 20000000:00000080:3.0:1790740378.862352:0:11659:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f0dbee1f400 uarg=0000000000000000 20000000:01000000:3.0:1790740378.862387:0:11659:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1790740378.862393:0:11659:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1790740378.862398:0:11659:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1790740378.863369:0:11660:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1790740378.863794:0:11659:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1790740378.874087:0:11659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1790740378.874141:0:11659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1790740378.874196:0:11659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1790740378.874214:0:11659:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1790740378.874234:0:11659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f0db6c0f600/0xc6b31a1b598e9e47 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740378.874254:0:11659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0d9f976600/0xc6b31a1b598e9ce2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee3c8 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740378.874263:0:11659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0d9f499200/0xc6b31a1b598e9ce9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee3cf expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740378.874271:0:11659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0d87594000/0xc6b31a1b598e9cf7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e9cf0 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740378.874277:0:11659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0d9f499600/0xc6b31a1b598e9d05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e9cfe expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740378.874284:0:11659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0d87595000/0xc6b31a1b598e9d13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e9d0c expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740378.874302:0:11659:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f0db6c0f600/0xc6b31a1b598e9e47 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740378.874341:0:11659:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0d87595000/0xc6b31a1b598e9d13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b31a1b598e9d0c expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740378.874356:0:11659:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f0d87595000/0xc6b31a1b598e9d13 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b31a1b598e9d0c expref: 18 pid: 5835 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740378.874370:0:11659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d8654a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11659:1877727158261504:0@lo:104: 00000100:00100000:3.0:1790740378.874434:0:11659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790740378.874597:0:11659:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0d9f499600/0xc6b31a1b598e9d05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b31a1b598e9cfe expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740378.874605:0:11659:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f0d9f499600/0xc6b31a1b598e9d05 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b31a1b598e9cfe expref: 18 pid: 5836 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740378.874614:0:11659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d86549880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11659:1877727158261632:0@lo:104: 00000100:00100000:3.0:1790740378.874636:0:11659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790740378.877265:0:11659:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0d87594000/0xc6b31a1b598e9cf7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b31a1b598e9cf0 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740378.877284:0:11659:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f0d87594000/0xc6b31a1b598e9cf7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b31a1b598e9cf0 expref: 18 pid: 5837 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740378.877299:0:11659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d86549180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11659:1877727158261760:0@lo:104: 00000100:00100000:3.0:1790740378.877357:0:11659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790740378.877382:0:11659:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0d9f499200/0xc6b31a1b598e9ce9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee3cf expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740378.877411:0:11659:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f0d9f499200/0xc6b31a1b598e9ce9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee3cf expref: 12 pid: 5835 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740378.877422:0:11659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d86548000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11659:1877727158261888:192.168.203.58@tcp:104: 00010000:00010000:3.0:1790740378.877490:0:11659:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0d9f976600/0xc6b31a1b598e9ce2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee3c8 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740378.877499:0:11659:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f0d9f976600/0xc6b31a1b598e9ce2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee3c8 expref: 12 pid: 5835 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740378.877507:0:11659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d8654b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11659:1877727158262016:192.168.203.58@tcp:104: 00000100:00100000:3.0:1790740378.879233:0:11659:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d8653db40 going to sleep for 11 seconds 00000100:00100000:2.0:1790740378.880240:0:5826:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1790740378.880257:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158261504 00000100:00100000:2.0:1790740378.880265:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158261504 00000100:00100000:2.0:1790740378.880298:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158261632 00000100:00100000:2.0:1790740378.880300:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158261632 00000100:00100000:2.0:1790740378.880308:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158261760 00000100:00100000:2.0:1790740378.880310:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158261760 00000100:00100000:2.0:1790740378.880325:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790740378.880332:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d86548e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+5:11659:x1877727158261504:12345-0@lo:104: 00010000:00010000:2.0:1790740378.880348:0:5826:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977a00/0xc6b31a1b598e9d0c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598e9d13 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740378.880419:0:5826:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790740378.880435:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d86548e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+5:11659:x1877727158261504:12345-0@lo:104: Request processed in 103us (6001us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740378.880451:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790740378.880467:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790740378.880473:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d86548a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+4:11659:x1877727158261632:12345-0@lo:104: 00010000:00010000:2.0:1790740378.880480:0:5826:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976000/0xc6b31a1b598e9cfe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598e9d05 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740378.880654:0:11659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d8654a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11659:1877727158261504:0@lo:104: 00000100:00100000:3.0:1790740378.880663:0:11659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d86549880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11659:1877727158261632:0@lo:104: 00010000:00010000:2.0:1790740378.880727:0:5826:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790740378.880733:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d86548a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+4:11659:x1877727158261632:12345-0@lo:104: Request processed in 260us (6096us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740378.880739:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790740378.880751:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790740378.880757:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+3:11659:x1877727158261760:12345-0@lo:104: 00010000:00010000:2.0:1790740378.880765:0:5826:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499800/0xc6b31a1b598e9cf0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598e9cf7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740378.880829:0:11659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d86549180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11659:1877727158261760:0@lo:104: 00010000:00010000:1.0:1790740378.881379:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1790740378.881387:0:5831:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977a00/0xc6b31a1b598e9d0c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598e9d13 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740378.881396:0:5831:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f977a00 already unused, calling callback (ffffffffc1baec20) 10000000:00010000:1.0:1790740378.881400:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977a00/0xc6b31a1b598e9d0c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b31a1b598e9d13 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740378.881409:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977a00/0xc6b31a1b598e9d0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b31a1b598e9d13 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790740378.881416:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977a00/0xc6b31a1b598e9d0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b31a1b598e9d13 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790740378.881421:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790740378.881466:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977a00/0xc6b31a1b598e9d0c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9d13 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740378.881473:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1790740378.881512:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3305:1877727158262144:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790740378.881557:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790740378.881768:0:5831:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977a00/0xc6b31a1b598e9d0c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9d13 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740378.881777:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977a00/0xc6b31a1b598e9d0c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9d13 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740378.881803:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790740378.881807:0:5831:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976000/0xc6b31a1b598e9cfe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598e9d05 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740378.881812:0:5831:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f976000 already unused, calling callback (ffffffffc1baec20) 10000000:00010000:1.0:1790740378.881815:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976000/0xc6b31a1b598e9cfe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b31a1b598e9d05 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740378.881822:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976000/0xc6b31a1b598e9cfe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b31a1b598e9d05 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790740378.881829:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976000/0xc6b31a1b598e9cfe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b31a1b598e9d05 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790740378.881834:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790740378.881851:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976000/0xc6b31a1b598e9cfe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9d05 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740378.881857:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1790740378.881900:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3306:1877727158262272:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790740378.881928:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790740378.882045:0:5826:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790740378.882052:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+3:11659:x1877727158261760:12345-0@lo:104: Request processed in 1296us (4695us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740378.882060:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1790740378.882114:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1790740378.882148:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158262144 00000100:00100000:2.0:1790740378.882153:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158262144 00010000:00010000:2.0:1790740378.882172:0:5829:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0d87595000/0xc6b31a1b598e9d13 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598e9d0c expref: 19 pid: 5835 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740378.882190:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158262272 00000100:00100000:2.0:1790740378.882197:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158262272 00010000:00010000:2.0:1790740378.882207:0:5829:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0d9f499600/0xc6b31a1b598e9d05 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598e9cfe expref: 20 pid: 5836 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740378.882222:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790740378.882228:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d86548700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+20:3305:x1877727158262144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790740378.882238:0:5829:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740378.882242:0:5829:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0d87595000/0xc6b31a1b598e9d13 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598e9d0c expref: 20 pid: 5835 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740378.882253:0:5829:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0d87595000/0xc6b31a1b598e9d13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b31a1b598e9d0c expref: 20 pid: 5835 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740378.882266:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0d87595000/0xc6b31a1b598e9d13 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b31a1b598e9d0c expref: 20 pid: 5835 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740378.882278:0:5829:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790740378.882376:0:5831:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976000/0xc6b31a1b598e9cfe lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9d05 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740378.882384:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976000/0xc6b31a1b598e9cfe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9d05 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740378.882395:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740378.882397:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740378.882398:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740378.882413:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790740378.882424:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3306:x1877727158262272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790740378.882431:0:5828:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740378.882435:0:5828:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0d9f499600/0xc6b31a1b598e9d05 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598e9cfe expref: 19 pid: 5836 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740378.882460:0:5828:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0d9f499600/0xc6b31a1b598e9d05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b31a1b598e9cfe expref: 19 pid: 5836 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740378.882469:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0d9f499600/0xc6b31a1b598e9d05 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b31a1b598e9cfe expref: 19 pid: 5836 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740378.882478:0:5828:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740378.882505:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+18:3306:x1877727158262272:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740378.882511:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790740378.882854:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3306:1877727158262272:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790740378.882953:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d86548700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+17:3305:x1877727158262144:12345-0@lo:103:ldlm_bl.0 Request processed in 724us (1395us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740378.882960:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:0.0:1790740378.883154:0:11661:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740378.883157:0:11661:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740378.883159:0:11661:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740378.883220:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3305:1877727158262144:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790740378.883274:0:5832:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499800/0xc6b31a1b598e9cf0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598e9cf7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740378.883281:0:5832:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f499800 already unused, calling callback (ffffffffc1baec20) 10000000:00010000:2.0:1790740378.883285:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499800/0xc6b31a1b598e9cf0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b31a1b598e9cf7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740378.883293:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499800/0xc6b31a1b598e9cf0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b31a1b598e9cf7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790740378.883309:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499800/0xc6b31a1b598e9cf0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b31a1b598e9cf7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790740378.883314:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790740378.883813:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499800/0xc6b31a1b598e9cf0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9cf7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740378.883822:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790740378.883854:0:5832:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499800/0xc6b31a1b598e9cf0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9cf7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740378.883862:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.158@tcp lock: ffff8f0d9f499800/0xc6b31a1b598e9cf0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598e9cf7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740378.883876:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740378.883878:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740378.883879:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740378.883909:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790740378.883922:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d87e23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3304:1877727158262400:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790740378.883964:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740378.884104:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158262400 00000100:00100000:2.0:1790740378.884110:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158262400 00010000:00010000:2.0:1790740378.884128:0:5828:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0d87594000/0xc6b31a1b598e9cf7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598e9cf0 expref: 17 pid: 5837 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740378.884156:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790740378.884163:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d87402450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+17:3304:x1877727158262400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790740378.884173:0:5828:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740378.884177:0:5828:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0d87594000/0xc6b31a1b598e9cf7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598e9cf0 expref: 17 pid: 5837 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740378.884186:0:5828:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0d87594000/0xc6b31a1b598e9cf7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b31a1b598e9cf0 expref: 17 pid: 5837 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740378.884206:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0d87594000/0xc6b31a1b598e9cf7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b31a1b598e9cf0 expref: 17 pid: 5837 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740378.884215:0:5828:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790740378.884251:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d87402450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+16:3304:x1877727158262400:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740378.884258:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790740378.884362:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d87e23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3304:1877727158262400:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790740378.885554:0:11659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d86548000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11659:1877727158261888:192.168.203.58@tcp:104: 00000100:00100000:1.0:1790740378.885565:0:11659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d8654b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11659:1877727158262016:192.168.203.58@tcp:104: 00010000:00010000:1.0:1790740378.885621:0:11659:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f0db6c0f600/0xc6b31a1b598e9e47 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740378.886131:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740378.886162:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740378.886217:0:8506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133063168 00000100:00100000:2.0:1790740378.886223:0:8506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133063168 00010000:00010000:2.0:1790740378.886251:0:8506:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0d9f499200/0xc6b31a1b598e9ce9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee3cf expref: 13 pid: 5835 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740378.886280:0:8506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133063296 00000100:00100000:2.0:1790740378.886283:0:8506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133063296 00010000:00010000:2.0:1790740378.886294:0:8506:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0d9f976600/0xc6b31a1b598e9ce2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee3c8 expref: 14 pid: 5835 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740378.886312:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 33 00000100:00100000:2.0:1790740378.886320:0:8506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d86549f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+14:2370:x1877727133063168:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790740378.886331:0:8506:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740378.886336:0:8506:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0d9f499200/0xc6b31a1b598e9ce9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee3cf expref: 14 pid: 5835 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740378.886345:0:8506:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0d9f499200/0xc6b31a1b598e9ce9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee3cf expref: 14 pid: 5835 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740378.886360:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0d9f499200/0xc6b31a1b598e9ce9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee3cf expref: 14 pid: 5835 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740378.886387:0:8506:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790740378.886431:0:8506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d86549f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:2370:x1877727133063168:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 111us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740378.886438:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 33 00000100:00100000:2.0:1790740378.886463:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 34 00000100:00100000:2.0:1790740378.886470:0:8506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8654aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+12:2370:x1877727133063296:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790740378.886478:0:8506:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740378.886482:0:8506:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0d9f976600/0xc6b31a1b598e9ce2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee3c8 expref: 12 pid: 5835 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740378.886492:0:8506:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0d9f976600/0xc6b31a1b598e9ce2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee3c8 expref: 12 pid: 5835 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740378.886501:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0d9f976600/0xc6b31a1b598e9ce2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee3c8 expref: 12 pid: 5835 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740378.886526:0:8506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f0db6c0f600/0xc6b31a1b598e9e47 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740378.886540:0:8506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0db6c0f600/0xc6b31a1b598e9e47 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740378.886553:0:8506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f0db6c0f600/0xc6b31a1b598e9e47 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740378.886560:0:8506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f0db6c0f600/0xc6b31a1b598e9e47 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740378.886598:0:8506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f0db6c0f600/0xc6b31a1b598e9e47 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740378.886605:0:8506:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f0db6c0f600/0xc6b31a1b598e9e47 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740378.886611:0:8506:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0f600 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:2.0:1790740378.886615:0:8506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f0db6c0f600/0xc6b31a1b598e9e47 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740378.886624:0:8506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f0db6c0f600/0xc6b31a1b598e9e47 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740378.886636:0:8506:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f0db6c0f600/0xc6b31a1b598e9e47 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740378.886646:0:8506:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790740378.886665:0:8506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8654aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+11:2370:x1877727133063296:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 196us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740378.886672:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 34 00010000:00010000:1.0:1790740378.886900:0:11659:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f0db6c0f600/0xc6b31a1b598e9e47 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740378.886908:0:11659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f0db6c0f600/0xc6b31a1b598e9e47 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740378.886920:0:11659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0db6c0f600/0xc6b31a1b598e9e47 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740378.931485:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740379.952835:0:11661:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740380.494651:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740380.494815:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133063424 00000100:00100000:0.0:1790740380.494825:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133063424 00000100:00100000:0.0:1790740380.494886:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 253 00000100:00100000:0.0:1790740380.494896:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d874ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+11:5611:x1877727133063424:12345-192.168.203.58@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790740380.494912:0:5835:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740380.494933:0:5835:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0d9fea6600/0xc6b31a1b598e9e4e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee41c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740380.494974:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0d9fea6600/0xc6b31a1b598e9e4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee41c expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740380.494987:0:5835:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0d9fea6600/0xc6b31a1b598e9e4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee41c expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740380.494995:0:5835:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9fea6600, rc 0) 00000100:00100000:0.0:1790740380.495049:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d874ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+12:5611:x1877727133063424:12345-192.168.203.58@tcp:101:ll_cfg_requeue.0 Request processed in 155us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740380.495057:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 253 00000100:00100000:0.0:1790740380.501190:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740380.501280:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133063552 00000100:00100000:2.0:1790740380.501291:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133063552 00000100:00100000:2.0:1790740380.501344:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 254 00000100:00100000:2.0:1790740380.501352:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d874ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+12:5611:x1877727133063552:12345-192.168.203.58@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790740380.501682:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d874ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+12:5611:x1877727133063552:12345-192.168.203.58@tcp:501:ll_cfg_requeue.0 Request processed in 329us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740380.501694:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 254 00000100:00100000:3.0:1790740380.504950:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740380.505089:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133063680 00000100:00100000:1.0:1790740380.505098:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133063680 00000100:00100000:1.0:1790740380.505150:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 255 00000100:00100000:1.0:1790740380.505161:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d874af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+12:5611:x1877727133063680:12345-192.168.203.58@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790740380.505374:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d874af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+12:5611:x1877727133063680:12345-192.168.203.58@tcp:503:ll_cfg_requeue.0 Request processed in 214us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740380.505382:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 255 00000100:00100000:1.0:1790740380.513701:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740380.514346:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133063808 00000100:00100000:0.0:1790740380.514356:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133063808 00000100:00100000:0.0:1790740380.514415:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 256 00000100:00100000:0.0:1790740380.514425:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d84877850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+12:9961:x1877727133063808:12345-192.168.203.58@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790740380.514742:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d84877850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+12:9961:x1877727133063808:12345-192.168.203.58@tcp:502:llog_process_th.0 Request processed in 318us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740380.514751:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 256 00000100:00100000:0.0:1790740380.517985:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740380.530530:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133063936 00000100:00100000:2.0:1790740380.530547:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133063936 00000100:00100000:2.0:1790740380.530624:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 257 00000100:00100000:2.0:1790740380.530634:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d84877c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+12:9961:x1877727133063936:12345-192.168.203.58@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790740380.530905:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d84877c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+12:9961:x1877727133063936:12345-192.168.203.58@tcp:502:llog_process_th.0 Request processed in 272us (12927us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740380.530913:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 257 00000100:00100000:3.0:1790740380.534687:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740380.534797:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133064064 00000100:00100000:2.0:1790740380.534808:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133064064 00000100:00100000:2.0:1790740380.534864:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 258 00000100:00100000:2.0:1790740380.534875:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d84876c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+12:5611:x1877727133064064:12345-192.168.203.58@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790740380.534891:0:5837:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740380.534910:0:5837:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0d87595000/0xc6b31a1b598e9e55 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee423 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740380.534938:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0d87595000/0xc6b31a1b598e9e55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee423 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740380.534950:0:5837:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0d87595000/0xc6b31a1b598e9e55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee423 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740380.534968:0:5837:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d87595000, rc 0) 00000100:00100000:2.0:1790740380.535024:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d84876c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:5611:x1877727133064064:12345-192.168.203.58@tcp:101:ll_cfg_requeue.0 Request processed in 151us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740380.535031:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 258 00000100:00100000:3.0:1790740380.547333:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740380.547512:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133064192 00000100:00100000:2.0:1790740380.547523:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133064192 00000100:00100000:2.0:1790740380.547624:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 259 00000100:00100000:2.0:1790740380.547635:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d84876850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:5611:x1877727133064192:12345-192.168.203.58@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790740380.547920:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d84876850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:5611:x1877727133064192:12345-192.168.203.58@tcp:501:ll_cfg_requeue.0 Request processed in 286us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740380.547929:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 259 00000100:00100000:2.0:1790740380.553544:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740380.553663:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133064320 00000100:00100000:1.0:1790740380.553686:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133064320 00000100:00100000:1.0:1790740380.553737:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 260 00000100:00100000:1.0:1790740380.553747:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:5611:x1877727133064320:12345-192.168.203.58@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790740380.554341:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:5611:x1877727133064320:12345-192.168.203.58@tcp:503:ll_cfg_requeue.0 Request processed in 594us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740380.554350:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 260 00000100:00100000:3.0:1790740380.578482:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740380.578712:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133064448 00000100:00100000:1.0:1790740380.578721:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133064448 00000100:00100000:1.0:1790740380.578771:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 261 00000100:00100000:1.0:1790740380.578780:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:9964:x1877727133064448:12345-192.168.203.58@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790740380.579016:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:9964:x1877727133064448:12345-192.168.203.58@tcp:502:llog_process_th.0 Request processed in 236us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740380.579031:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 261 00000100:00100000:3.0:1790740380.582457:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740380.582549:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133064576 00000100:00100000:2.0:1790740380.582559:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133064576 00000100:00100000:2.0:1790740380.582652:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 262 00000100:00100000:2.0:1790740380.582662:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:9964:x1877727133064576:12345-192.168.203.58@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790740380.582906:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:9964:x1877727133064576:12345-192.168.203.58@tcp:502:llog_process_th.0 Request processed in 245us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740380.582913:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 262 10000000:01000000:0.0:1790740380.787462:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790740380.787470:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f0db562c800 from 7 10000000:01000000:0.0:1790740380.787474:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790740380.787523:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea6200/0xc6b31a1b598e9e5c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740380.787537:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea6200/0xc6b31a1b598e9e5c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740380.787548:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea6200/0xc6b31a1b598e9e5c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740380.787607:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158262528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790740380.787676:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740380.787731:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d84989180 going to sleep for 11 seconds 00000100:00100000:2.0:1790740380.788611:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158262528 00000100:00100000:2.0:1790740380.788620:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158262528 00000100:00100000:2.0:1790740380.788667:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1790740380.788676:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+16:5841:x1877727158262528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790740380.788689:0:5836:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740380.788703:0:5836:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0d87594c00/0xc6b31a1b598e9e63 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b31a1b598e9e5c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740380.788726:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0d87594c00/0xc6b31a1b598e9e63 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b31a1b598e9e5c expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740380.788736:0:5836:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0d87594c00/0xc6b31a1b598e9e63 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e9e5c expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740380.788762:0:5836:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d87594c00, rc 0) 00000100:00100000:2.0:1790740380.788820:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+17:5841:x1877727158262528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (1142us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740380.788827:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1790740380.790459:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158262528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790740380.790488:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea6200/0xc6b31a1b598e9e5c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9e63 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740380.790500:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea6200/0xc6b31a1b598e9e5c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598e9e63 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740380.790616:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158262656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790740380.790671:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740380.790724:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d84989180 going to sleep for 11 seconds 00000100:00100000:1.0:1790740380.791075:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158262656 00000100:00100000:1.0:1790740380.791082:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158262656 00000100:00100000:1.0:1790740380.791135:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1790740380.791144:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+17:5841:x1877727158262656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790740380.791409:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+17:5841:x1877727158262656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 266us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740380.791417:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1790740380.792207:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158262656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790740380.792254:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158262784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790740380.792320:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740380.792355:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d84989180 going to sleep for 11 seconds 00000100:00100000:1.0:1790740380.792938:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158262784 00000100:00100000:1.0:1790740380.792947:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158262784 00000100:00100000:1.0:1790740380.793062:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1790740380.793071:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+17:5841:x1877727158262784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790740380.793337:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+17:5841:x1877727158262784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 266us (1016us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740380.793345:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1790740380.796547:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158262784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790740380.804444:0:11674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a3d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:11674:1877727158262912:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790740380.804541:0:11674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740380.804748:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158262912 00000100:00100000:2.0:1790740380.804756:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158262912 00000100:00100000:2.0:1790740380.804810:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1790740380.804820:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+17:11674:x1877727158262912:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790740380.805299:0:11674:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0db6ff6000 going to sleep for 11 seconds 00000100:00100000:2.0:1790740380.810492:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+17:11674:x1877727158262912:12345-0@lo:502:llog_process_th.0 Request processed in 5663us (5941us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740380.810496:0:11674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a3d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:11674:1877727158262912:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790740380.810525:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000020:01000000:1.0:1790740380.810546:0:11674:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790740380.810559:0:11674:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740380.810562:0:11674:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790740380.810569:0:11674:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f0db562c800 00000020:00000080:1.0:1790740380.810714:0:11674:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1790740380.810806:0:11674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a3d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:11674:1877727158263040:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790740380.810940:0:11674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740380.811424:0:11674:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0db6ff6000 going to sleep for 11 seconds 00000100:00100000:0.0:1790740380.814421:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158263040 00000100:00100000:0.0:1790740380.814444:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158263040 00000100:00100000:0.0:1790740380.814504:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1790740380.814514:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+17:11674:x1877727158263040:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790740380.814792:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+17:11674:x1877727158263040:12345-0@lo:502:llog_process_th.0 Request processed in 279us (3852us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740380.814800:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1790740380.816175:0:11674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a3d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:11674:1877727158263040:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790740380.816212:0:11674:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790740380.816220:0:11674:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740380.816223:0:11674:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1790740380.816227:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1790740380.816400:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1790740380.816424:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790740380.816444:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea6200/0xc6b31a1b598e9e5c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9e63 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740380.816457:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea6200/0xc6b31a1b598e9e5c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9e63 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740380.816467:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790740380.816470:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f0d83fe1000 from 7 10000000:01000000:0.0:1790740380.816473:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790740380.816508:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea6e00/0xc6b31a1b598e9e6a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740380.816529:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea6e00/0xc6b31a1b598e9e6a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740380.816550:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea6e00/0xc6b31a1b598e9e6a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740380.816601:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda71f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158263168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790740380.816649:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740380.816683:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d84989f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790740380.817000:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158263168 00000100:00100000:1.0:1790740380.817008:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158263168 00000100:00100000:1.0:1790740380.817053:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1790740380.817062:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+17:5841:x1877727158263168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790740380.817075:0:5836:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740380.817088:0:5836:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0d9f977a00/0xc6b31a1b598e9e71 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b31a1b598e9e6a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740380.817113:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0d9f977a00/0xc6b31a1b598e9e71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b31a1b598e9e6a expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740380.817125:0:5836:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0d9f977a00/0xc6b31a1b598e9e71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e9e6a expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740380.817134:0:5836:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9f977a00, rc 0) 00000100:00100000:1.0:1790740380.817171:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+18:5841:x1877727158263168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740380.817178:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1790740380.817319:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda71f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158263168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790740380.817333:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea6e00/0xc6b31a1b598e9e6a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9e71 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740380.817341:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea6e00/0xc6b31a1b598e9e6a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598e9e71 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740380.817389:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda71f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158263296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790740380.817415:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740380.817450:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d84989f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790740380.817463:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158263296 00000100:00100000:0.0:1790740380.817467:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158263296 00000100:00100000:0.0:1790740380.817488:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1790740380.817494:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+18:5841:x1877727158263296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790740380.817894:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+18:5841:x1877727158263296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 400us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740380.817902:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1790740380.817978:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda71f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158263296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790740380.818010:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a3d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158263424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790740380.818054:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740380.818075:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0db6ff6840 going to sleep for 11 seconds 00000100:00100000:0.0:1790740380.818173:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158263424 00000100:00100000:0.0:1790740380.818178:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158263424 00000100:00100000:0.0:1790740380.818238:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1790740380.818251:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+18:5841:x1877727158263424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790740380.818402:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+18:5841:x1877727158263424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740380.818409:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1790740380.818481:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a3d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158263424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790740380.818734:0:11676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d87e22d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:11676:1877727158263552:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790740380.818767:0:11676:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740380.827969:0:11676:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0dbda3db40 going to sleep for 11 seconds 00000100:00100000:1.0:1790740380.828260:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158263552 00000100:00100000:1.0:1790740380.828357:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158263552 00000100:00100000:1.0:1790740380.828405:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1790740380.828415:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+18:11676:x1877727158263552:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790740380.829949:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+18:11676:x1877727158263552:12345-0@lo:502:llog_process_th.0 Request processed in 1529us (11174us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740380.829962:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1790740380.830062:0:11676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d87e22d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:11676:1877727158263552:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790740380.830096:0:11676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790740380.830106:0:11676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790740380.830109:0:11676:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1790740380.830283:0:11676:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f0d83fe1000 00000020:00000080:2.0:1790740380.830287:0:11676:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1790740380.830439:0:11676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d87e22d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:11676:1877727158263680:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790740380.830502:0:11676:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740380.830540:0:11676:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0dbda3db40 going to sleep for 11 seconds 00000100:00100000:1.0:1790740380.830616:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158263680 00000100:00100000:1.0:1790740380.830623:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158263680 00000100:00100000:1.0:1790740380.830660:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1790740380.830668:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+18:11676:x1877727158263680:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790740380.830951:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+18:11676:x1877727158263680:12345-0@lo:502:llog_process_th.0 Request processed in 284us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740380.830959:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1790740380.831976:0:11676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d87e22d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:11676:1877727158263680:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790740380.832024:0:11676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790740380.832031:0:11676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790740380.832033:0:11676:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1790740380.832040:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1790740380.832360:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1790740380.832386:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790740380.832398:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea6e00/0xc6b31a1b598e9e6a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9e71 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740380.832410:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea6e00/0xc6b31a1b598e9e6a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9e71 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740380.832421:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790740380.832424:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f0d85311800 from 7 10000000:01000000:0.0:1790740380.832436:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790740380.832468:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7400/0xc6b31a1b598e9e78 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740380.832477:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7400/0xc6b31a1b598e9e78 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740380.832486:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7400/0xc6b31a1b598e9e78 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740380.832507:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda72a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158263808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790740380.832555:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740380.832686:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d849899c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790740380.832883:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158263808 00000100:00100000:1.0:1790740380.832890:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158263808 00000100:00100000:1.0:1790740380.832969:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1790740380.832979:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+18:5841:x1877727158263808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790740380.832991:0:5836:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740380.833003:0:5836:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0d9f976800/0xc6b31a1b598e9e7f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b31a1b598e9e78 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740380.833025:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0d9f976800/0xc6b31a1b598e9e7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b31a1b598e9e78 expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740380.833049:0:5836:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0d9f976800/0xc6b31a1b598e9e7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598e9e78 expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740380.833057:0:5836:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9f976800, rc 0) 00000100:00100000:1.0:1790740380.833104:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:5841:x1877727158263808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740380.833110:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1790740380.833192:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda72a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158263808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790740380.833206:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7400/0xc6b31a1b598e9e78 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9e7f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740380.833220:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7400/0xc6b31a1b598e9e78 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598e9e7f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740380.833269:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda72a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158263936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790740380.833295:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740380.833512:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d849899c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790740380.833559:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158263936 00000100:00100000:2.0:1790740380.833564:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158263936 00000100:00100000:2.0:1790740380.833610:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1790740380.833617:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:5841:x1877727158263936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790740380.833854:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:5841:x1877727158263936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 237us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740380.833861:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1790740380.833895:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda72a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158263936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790740380.833929:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d87e22d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158264064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790740380.833969:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740380.833990:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0dbda3d000 going to sleep for 11 seconds 00000100:00100000:2.0:1790740380.834001:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158264064 00000100:00100000:2.0:1790740380.834005:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158264064 00000100:00100000:2.0:1790740380.834023:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1790740380.834029:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:5841:x1877727158264064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790740380.834694:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:5841:x1877727158264064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 662us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740380.834702:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1790740380.834761:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d87e22d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:10ce3df1-3f26-4bb4-b4c3-d740981d121e:5841:1877727158264064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790740380.834939:0:11678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d87e22d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:11678:1877727158264192:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790740380.834977:0:11678:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740380.835000:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158264192 00000100:00100000:2.0:1790740380.835005:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158264192 00000100:00100000:2.0:1790740380.835025:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1790740380.835032:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83fec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:11678:x1877727158264192:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790740380.835274:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83fec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:11678:x1877727158264192:12345-0@lo:502:llog_process_th.0 Request processed in 242us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740380.835282:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1790740380.835323:0:11678:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d83e11840 going to sleep for 11 seconds 00000100:00100000:2.0:1790740380.835337:0:11678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d87e22d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:11678:1877727158264192:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790740380.835361:0:11678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790740380.835370:0:11678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790740380.835372:0:11678:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1790740380.835381:0:11678:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f0d85311800 00000020:00000080:2.0:1790740380.835384:0:11678:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1790740380.835472:0:11678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d87e22d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:11678:1877727158264320:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790740380.835509:0:11678:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740380.835530:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158264320 00000100:00100000:2.0:1790740380.835534:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158264320 00000100:00100000:2.0:1790740380.835553:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1790740380.835560:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83fed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:11678:x1877727158264320:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790740380.835697:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83fed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:11678:x1877727158264320:12345-0@lo:502:llog_process_th.0 Request processed in 137us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740380.835704:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1790740380.836248:0:11678:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d87549480 going to sleep for 11 seconds 00000100:00100000:2.0:1790740380.836264:0:11678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d87e22d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:10ce3df1-3f26-4bb4-b4c3-d740981d121e:11678:1877727158264320:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790740380.836286:0:11678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790740380.836292:0:11678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790740380.836294:0:11678:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1790740380.836298:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1790740380.836346:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1790740380.836362:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790740380.836372:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7400/0xc6b31a1b598e9e78 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9e7f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740380.836383:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7400/0xc6b31a1b598e9e78 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9e7f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790740380.847744:0:11679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790740380.977393:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740380.977624:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158264704:0@lo:400:kworker.0 00000100:00100000:0.0:1790740380.977691:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740380.977756:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790740380.977763:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1877727158264576:0@lo:400:kworker.0 00000100:00100000:0.0:1790740380.977791:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740380.977823:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158264704 00000100:00100000:0.0:1790740380.977831:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158264704 00000100:00100000:0.0:1790740380.977885:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1790740380.977894:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1877727158264704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740380.977943:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1877727158264704:12345-0@lo:400:kworker.0 Request processed in 50us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740380.977951:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1790740380.977988:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158264576 00000100:00100000:0.0:1790740380.977992:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158264576 00000100:00100000:0.0:1790740380.978032:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1790740380.978041:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877727158264576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740380.978071:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877727158264576:12345-0@lo:400:kworker.0 Request processed in 32us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740380.978077:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:0.0:1790740380.978107:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790740380.978111:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790740380.978145:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1877727158264576:0@lo:400:kworker.0 00010000:00080000:0.0:1790740380.978159:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dbda71f80 x1877727158264704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740380.978170:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158264704:0@lo:400:kworker.0 00000100:00100000:3.0:1790740380.978438:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1877727158264832:0@lo:400:kworker.0 00000100:00100000:3.0:1790740380.978470:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740380.978500:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1790740380.978507:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877727158264448:0@lo:400:kworker.0 00000100:00100000:3.0:1790740380.978530:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740380.978554:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158264960:0@lo:400:kworker.0 00000100:00100000:3.0:1790740380.978604:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740380.978639:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158264832 00000100:00100000:3.0:1790740380.978643:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158264832 00000100:00100000:3.0:1790740380.978672:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158264448 00000100:00100000:3.0:1790740380.978675:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158264448 00000100:00100000:3.0:1790740380.978688:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1790740380.978694:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d86549c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877727158264832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740380.978732:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d86549c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877727158264832:12345-0@lo:400:kworker.0 Request processed in 37us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740380.978738:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1790740380.978754:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1790740380.978760:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d86549500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877727158264448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740380.978788:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d86549500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877727158264448:12345-0@lo:400:kworker.0 Request processed in 28us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740380.978795:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1790740380.978812:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158264960 00000100:00100000:3.0:1790740380.978816:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158264960 00000100:00100000:3.0:1790740380.978841:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790740380.978847:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8654b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1877727158264960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740380.978878:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8654b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1877727158264960:12345-0@lo:400:kworker.0 Request processed in 31us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740380.978892:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:3.0:1790740380.978908:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790740380.978911:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790740380.978937:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877727158264448:0@lo:400:kworker.0 00000100:00100000:3.0:1790740380.978947:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158264960:0@lo:400:kworker.0 00000100:00100000:3.0:1790740380.978956:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1877727158264832:0@lo:400:kworker.0 00000100:00100000:3.0:1790740381.490600:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d87e22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158265088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790740381.490665:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740381.490870:0:6703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158265088 00000100:00100000:2.0:1790740381.490878:0:6703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158265088 00000100:00100000:2.0:1790740381.490926:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790740381.490934:0:6703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d86548000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1877727158265088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790740381.490965:0:6703:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790740381.491008:0:6703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d86548000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1877727158265088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740381.491014:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790740381.491067:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d87e22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158265088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790740381.580355:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740381.580403:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740381.580444:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740381.580480:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740381.580480:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133064704 00000100:00100000:2.0:1790740381.580491:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133064704 00000100:00100000:3.0:1790740381.580508:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133064960 00000100:00100000:3.0:1790740381.580513:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133064960 00000100:00100000:3.0:1790740381.580562:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 61 00000100:00100000:3.0:1790740381.580597:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8654a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec599375-3198-45fd-a23a-c5620f07177c+5:2371:x1877727133064960:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:3.0:1790740381.580665:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8654a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec599375-3198-45fd-a23a-c5620f07177c+5:2371:x1877727133064960:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 95us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740381.580685:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 61 00000100:00100000:2.0:1790740381.580695:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 278 00000100:00100000:2.0:1790740381.580708:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83fef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:2371:x1877727133064704:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:2.0:1790740381.580767:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83fef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:2371:x1877727133064704:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 63us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740381.580779:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 278 00000100:00100000:1.0:1790740381.580867:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133064832 00000100:00100000:1.0:1790740381.580872:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133064832 00000100:00100000:1.0:1790740381.580900:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133065088 00000100:00100000:1.0:1790740381.580903:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133065088 00000100:00100000:1.0:1790740381.581057:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 109 00000100:00100000:1.0:1790740381.581066:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d86549180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+5:2372:x1877727133064832:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:0.0:1790740381.581611:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 110 00000100:00100000:0.0:1790740381.581624:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d86549880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+5:2372:x1877727133065088:12345-192.168.203.58@tcp:400:kworker.0 00000100:00080000:2.0:1790740381.584694:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790740381.584707:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790740381.588223:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d86549880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+5:2372:x1877727133065088:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 6590us (7765us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740381.588238:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 110 00000100:00100000:1.0:1790740381.588407:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d86549180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+5:2372:x1877727133064832:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 7339us (8058us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740381.588416:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 109 00000040:00080000:1.0:1790740381.874291:0:11679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790740382.000792:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740382.001629:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d86548700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158265216:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790740382.001704:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740382.001853:0:6703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158265216 00000100:00100000:3.0:1790740382.001863:0:6703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158265216 00000100:00100000:3.0:1790740382.001938:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790740382.001948:0:6703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877727158265216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790740382.001982:0:6703:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790740382.002044:0:6703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877727158265216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740382.002052:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:3.0:1790740382.002094:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0d86548700 x1877727158265216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740398 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740382.002125:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d86548700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158265216:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1790740382.003380:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790740383.026677:0:11661:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1790740383.075075:0:7642:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:2.0:1790740384.049021:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740385.072984:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740386.098526:0:11661:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740386.102214:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd7d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158265728:0@lo:400:kworker.0 00000100:00100000:0.0:1790740386.102215:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d87e23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1877727158265600:0@lo:400:kworker.0 00000100:00100000:2.0:1790740386.102293:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740386.102294:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740386.102353:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d87e20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877727158265472:0@lo:400:kworker.0 00000100:00100000:3.0:1790740386.102373:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d87e22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3303:1877727158265344:0@lo:400:kworker.0 00000100:00100000:0.0:1790740386.105484:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158265728 00000100:00100000:0.0:1790740386.105499:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158265728 00000100:00100000:0.0:1790740386.105564:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790740386.105591:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd7d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1877727158265728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740386.105657:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd7d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1877727158265728:12345-0@lo:400:kworker.0 Request processed in 85us (3367us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740386.105665:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:0.0:1790740386.105686:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790740386.105705:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158265600 00000100:00100000:0.0:1790740386.105709:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158265600 00000100:00100000:0.0:1790740386.105738:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1790740386.105758:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877727158265600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740386.105796:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877727158265600:12345-0@lo:400:kworker.0 Request processed in 40us (3506us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740386.105802:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:0.0:1790740386.105818:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790740386.105847:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d87e23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1877727158265600:0@lo:400:kworker.0 00010000:00080000:2.0:1790740386.107557:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dbd7d4a80 x1877727158265728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740386.108401:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740386.108449:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd7d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158265984:0@lo:400:kworker.0 00000100:00100000:1.0:1790740386.108513:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740386.108604:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158265472 00000100:00100000:1.0:1790740386.108612:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158265472 00000100:00100000:1.0:1790740386.108653:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1790740386.108662:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1a3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877727158265472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740386.108717:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1a3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877727158265472:12345-0@lo:400:kworker.0 Request processed in 56us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740386.108724:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1790740386.108763:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d87e20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877727158265472:0@lo:400:kworker.0 00000100:00100000:1.0:1790740386.108799:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158265984 00000100:00100000:1.0:1790740386.108803:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158265984 00000100:00100000:1.0:1790740386.108835:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1790740386.108842:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1a3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158265984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740386.108878:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1a3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158265984:12345-0@lo:400:kworker.0 Request processed in 36us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740386.108884:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:1.0:1790740386.108902:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790740386.110301:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:1.0:1790740386.110310:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f0dbda71180, transno 4294967300 00000100:00100000:1.0:1790740386.110328:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd7d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158265984:0@lo:400:kworker.0 00000100:00100000:3.0:1790740386.112275:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740386.112339:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd7d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1877727158265856:0@lo:400:kworker.0 00000100:00100000:3.0:1790740386.112376:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740386.113012:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd7d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158265728:0@lo:400:kworker.0 00000100:00100000:2.0:1790740386.113067:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158265856 00000100:00100000:2.0:1790740386.113076:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158265856 00000100:00100000:2.0:1790740386.113134:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1790740386.113143:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d86548700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877727158265856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740386.113203:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d86548700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877727158265856:12345-0@lo:400:kworker.0 Request processed in 61us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740386.113210:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1790740386.113781:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158265344 00000100:00100000:1.0:1790740386.113788:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158265344 00000100:00100000:1.0:1790740386.113824:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1790740386.113832:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83fed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3303:x1877727158265344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740386.113875:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83fed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3303:x1877727158265344:12345-0@lo:400:kworker.0 Request processed in 44us (1606us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740386.113897:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00080000:3.0:1790740386.113977:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790740386.114804:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d87e22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3303:1877727158265344:0@lo:400:kworker.0 00000100:00100000:3.0:1790740386.114821:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd7d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1877727158265856:0@lo:400:kworker.0 00000100:00100000:2.0:1790740386.611444:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158266112:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790740386.611527:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740386.612857:0:6703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158266112 00000100:00100000:0.0:1790740386.612871:0:6703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158266112 00000100:00100000:0.0:1790740386.612940:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1790740386.612951:0:6703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd7d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158266112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790740386.613185:0:6703:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790740386.613273:0:6703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd7d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158266112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 323us (1754us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740386.613359:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790740386.613864:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158266112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790740386.698638:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740386.698678:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740386.698724:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740386.698818:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133065344 00000100:00100000:2.0:1790740386.698836:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133065344 00000100:00100000:2.0:1790740386.698897:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133065600 00000100:00100000:2.0:1790740386.698915:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133065600 00000100:00100000:2.0:1790740386.698957:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 114 00000100:00100000:2.0:1790740386.698967:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d86548e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+5:2372:x1877727133065344:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:2.0:1790740386.699034:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d86548e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+5:2372:x1877727133065344:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 69us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740386.699041:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 114 00000100:00100000:2.0:1790740386.699058:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 115 00000100:00100000:2.0:1790740386.699064:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d86548a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+5:2372:x1877727133065600:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:2.0:1790740386.699089:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d86548a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+5:2372:x1877727133065600:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 25us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740386.699095:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 115 00000100:00100000:0.0:1790740386.699530:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133065216 00000100:00100000:0.0:1790740386.699536:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133065216 00000100:00100000:0.0:1790740386.699597:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 280 00000100:00100000:0.0:1790740386.699616:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83fee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:2372:x1877727133065216:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:0.0:1790740386.699655:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83fee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:2372:x1877727133065216:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 41us (931us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740386.699661:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 280 00000100:00080000:3.0:1790740386.699934:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790740386.700226:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740386.700539:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133065472 00000100:00100000:3.0:1790740386.700546:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133065472 00000100:00080000:1.0:1790740386.700780:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790740386.701128:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 64 00000100:00100000:3.0:1790740386.701138:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec599375-3198-45fd-a23a-c5620f07177c+5:2372:x1877727133065472:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:3.0:1790740386.701195:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec599375-3198-45fd-a23a-c5620f07177c+5:2372:x1877727133065472:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 60us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740386.701202:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 64 00010000:00010000:2.0:1790740387.121273:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740387.129795:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbee2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158266240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790740387.129872:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740387.134231:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158266240 00000100:00100000:3.0:1790740387.134260:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158266240 00000100:00100000:3.0:1790740387.134329:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790740387.134341:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd7d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877727158266240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790740387.134379:0:6704:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790740387.134492:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd7d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877727158266240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 154us (4619us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740387.134499:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:2.0:1790740387.134759:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dbee2c380 x1877727158266240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740403 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740387.134781:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbee2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158266240:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790740388.147316:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740389.168819:0:11661:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740390.192770:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790740391.090517:0:11679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790740391.216775:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740391.217995:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbee2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3303:1877727158266368:0@lo:400:kworker.0 00000100:00100000:1.0:1790740391.218059:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbee2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877727158266496:0@lo:400:kworker.0 00000100:00100000:0.0:1790740391.218067:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740391.218090:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740391.218139:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbee2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1877727158266624:0@lo:400:kworker.0 00000100:00100000:3.0:1790740391.218254:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158266368 00000100:00100000:3.0:1790740391.218262:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158266368 00000100:00100000:3.0:1790740391.218755:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1790740391.218768:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83fee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3303:x1877727158266368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740391.226583:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbee2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158267008:0@lo:400:kworker.0 00000100:00100000:2.0:1790740391.226593:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740391.226625:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740391.226642:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790740391.226650:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbee2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158266752:0@lo:400:kworker.0 00000100:00100000:1.0:1790740391.226668:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158267008 00000100:00100000:2.0:1790740391.226672:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740391.226676:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158267008 00000100:00100000:2.0:1790740391.226705:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158266496 00000100:00100000:2.0:1790740391.226709:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158266496 00000100:00100000:1.0:1790740391.226722:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158266752 00000100:00100000:1.0:1790740391.226724:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158266752 00000100:00100000:2.0:1790740391.226747:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158266624 00000100:00100000:2.0:1790740391.226750:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158266624 00000100:00100000:2.0:1790740391.226771:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1790740391.226779:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877727158266496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740391.226837:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877727158266496:12345-0@lo:400:kworker.0 Request processed in 58us (8745us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740391.226844:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1790740391.226859:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1790740391.226866:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd7d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877727158266624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740391.227021:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd7d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877727158266624:12345-0@lo:400:kworker.0 Request processed in 154us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740391.227027:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1790740391.227412:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790740391.227418:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790740391.227421:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158267008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740391.227425:0:8460:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd7d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158266752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740391.227455:0:8460:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd7d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158266752:12345-0@lo:400:kworker.0 Request processed in 30us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740391.227455:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158267008:12345-0@lo:400:kworker.0 Request processed in 37us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740391.227462:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790740391.227503:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbee2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1877727158266880:0@lo:400:kworker.0 00000100:00100000:0.0:1790740391.227535:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1790740391.227715:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790740391.227720:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790740391.227722:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790740391.227742:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158266880 00000100:00100000:0.0:1790740391.227747:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158266880 00000100:00100000:0.0:1790740391.227779:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1790740391.227787:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877727158266880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740391.227823:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877727158266880:12345-0@lo:400:kworker.0 Request processed in 37us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740391.227829:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:0.0:1790740391.227847:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790740391.227875:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbee2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877727158266496:0@lo:400:kworker.0 00000100:00100000:1.0:1790740391.227906:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1790740391.227959:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbee2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158267008:0@lo:400:kworker.0 00010000:00080000:0.0:1790740391.227992:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dbee2d180 x1877727158266752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740391.228003:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbee2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158266752:0@lo:400:kworker.0 00000100:00100000:0.0:1790740391.228014:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbee2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1877727158266624:0@lo:400:kworker.0 00000100:00100000:0.0:1790740391.228038:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbee2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1877727158266880:0@lo:400:kworker.0 00000100:00100000:3.0:1790740391.228539:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83fee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3303:x1877727158266368:12345-0@lo:400:kworker.0 Request processed in 9771us (10468us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740391.228548:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1790740391.228677:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbee2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3303:1877727158266368:0@lo:400:kworker.0 00000100:00100000:0.0:1790740391.729173:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790740391.729196:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158267136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790740391.729268:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740391.729364:0:6703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158267136 00000100:00100000:0.0:1790740391.729372:0:6703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158267136 00000100:00100000:0.0:1790740391.729420:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790740391.729429:0:6703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877727158267136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790740391.729460:0:6703:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790740391.729504:0:6703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877727158267136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740391.729510:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790740391.729557:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158267136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790740391.820820:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740391.820895:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740391.821411:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133065728 00000100:00100000:2.0:1790740391.821423:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133065728 00000100:00100000:2.0:1790740391.821482:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 282 00000100:00100000:2.0:1790740391.821494:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83fef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:2371:x1877727133065728:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:2.0:1790740391.821605:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83fef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:2371:x1877727133065728:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 113us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740391.821613:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 282 00000100:00100000:1.0:1790740391.822548:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133065984 00000100:00100000:1.0:1790740391.822557:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133065984 00000100:00100000:1.0:1790740391.822626:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 67 00000100:00100000:1.0:1790740391.822634:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec599375-3198-45fd-a23a-c5620f07177c+5:2371:x1877727133065984:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:1.0:1790740391.822682:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec599375-3198-45fd-a23a-c5620f07177c+5:2371:x1877727133065984:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 49us (1797us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740391.822689:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 67 00000100:00080000:3.0:1790740391.823201:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790740391.824669:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740391.825428:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740391.828252:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133065856 00000100:00100000:0.0:1790740391.828252:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133066112 00000100:00100000:2.0:1790740391.828267:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133065856 00000100:00100000:0.0:1790740391.828267:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133066112 00000100:00100000:0.0:1790740391.828373:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 119 00000100:00100000:0.0:1790740391.828383:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+5:2372:x1877727133066112:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:0.0:1790740391.828476:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+5:2372:x1877727133066112:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 94us (3050us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740391.828485:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 119 00000100:00100000:0.0:1790740391.828507:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 120 00000100:00100000:0.0:1790740391.828515:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+5:2372:x1877727133065856:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:0.0:1790740391.828541:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+5:2372:x1877727133065856:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 28us (3877us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740391.828546:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 120 00000100:00080000:3.0:1790740391.828704:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1790740392.240770:0:11661:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740392.242518:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbee2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158267264:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790740392.242691:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740392.243269:0:6703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158267264 00000100:00100000:1.0:1790740392.243277:0:6703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158267264 00000100:00100000:1.0:1790740392.243374:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1790740392.243385:0:6703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877727158267264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790740392.243420:0:6703:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790740392.243479:0:6703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877727158267264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740392.243486:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:2.0:1790740392.243552:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dbee2c700 x1877727158267264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740408 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740392.243569:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbee2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158267264:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1790740393.265233:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740394.288739:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740395.312846:0:11661:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740396.336768:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740396.338270:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1b6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158267776:0@lo:400:kworker.0 00000100:00100000:2.0:1790740396.338349:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740396.338426:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790740396.338433:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1b6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1877727158267648:0@lo:400:kworker.0 00000100:00100000:2.0:1790740396.338459:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740396.339162:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1b6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3303:1877727158267392:0@lo:400:kworker.0 00000100:00100000:0.0:1790740396.339216:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740396.339255:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1b6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1877727158267904:0@lo:400:kworker.0 00000100:00100000:0.0:1790740396.339280:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740396.339300:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1790740396.339306:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1b6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877727158267520:0@lo:400:kworker.0 00000100:00100000:0.0:1790740396.339341:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740396.339360:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1b6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158268032:0@lo:400:kworker.0 00000100:00100000:0.0:1790740396.339510:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740396.339541:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158267648 00000100:00100000:0.0:1790740396.339548:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158267648 00000100:00100000:0.0:1790740396.339620:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158267904 00000100:00100000:0.0:1790740396.339624:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158267904 00000100:00100000:0.0:1790740396.339636:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158267520 00000100:00100000:0.0:1790740396.339638:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158267520 00000100:00100000:0.0:1790740396.339650:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1790740396.339657:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1b6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877727158267648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740396.339707:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1b6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877727158267648:12345-0@lo:400:kworker.0 Request processed in 50us (1247us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740396.339714:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1790740396.339730:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1790740396.339735:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877727158267904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740396.339763:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877727158267904:12345-0@lo:400:kworker.0 Request processed in 28us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740396.339784:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1790740396.339797:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1790740396.339802:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d87e22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877727158267520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740396.339841:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d87e22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877727158267520:12345-0@lo:400:kworker.0 Request processed in 38us (498us total) trans 0 rc 0/0 00000100:00080000:3.0:1790740396.339843:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790740396.339852:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1790740396.339949:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158267776 00000100:00100000:1.0:1790740396.339955:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158267776 00000100:00100000:3.0:1790740396.339958:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1b6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1877727158267648:0@lo:400:kworker.0 00000100:00080000:3.0:1790740396.340036:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790740396.340068:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158267392 00000100:00100000:3.0:1790740396.340075:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158267392 00000100:00100000:3.0:1790740396.340129:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1790740396.340137:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83fefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3303:x1877727158267392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740396.340211:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83fefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3303:x1877727158267392:12345-0@lo:400:kworker.0 Request processed in 75us (995us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740396.340219:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1790740396.340339:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1b6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877727158267520:0@lo:400:kworker.0 00000100:00100000:0.0:1790740396.340354:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1b6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3303:1877727158267392:0@lo:400:kworker.0 00000100:00100000:0.0:1790740396.340363:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1b6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1877727158267904:0@lo:400:kworker.0 00000100:00100000:1.0:1790740396.343707:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158268032 00000100:00100000:1.0:1790740396.343720:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158268032 00000100:00080000:3.0:1790740396.343827:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790740396.351927:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1790740396.351953:0:8460:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1b6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1877727158267776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740396.352084:0:8460:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1b6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1877727158267776:12345-0@lo:400:kworker.0 Request processed in 145us (13734us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740396.352092:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1790740396.352114:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1790740396.352122:0:8460:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d87e20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158268032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740396.352163:0:8460:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d87e20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158268032:12345-0@lo:400:kworker.0 Request processed in 42us (12653us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740396.352180:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1790740396.352243:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1b6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158268032:0@lo:400:kworker.0 00010000:00080000:3.0:1790740396.353676:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dc1b6f100 x1877727158267776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740396.353691:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1b6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158267776:0@lo:400:kworker.0 00000100:00100000:3.0:1790740396.852971:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1b6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158268160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790740396.853041:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740396.853187:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158268160 00000100:00100000:1.0:1790740396.853196:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158268160 00000100:00100000:1.0:1790740396.853258:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790740396.853268:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158268160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790740396.853304:0:6704:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790740396.853741:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158268160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 473us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740396.853750:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790740396.853837:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1b6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158268160:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790740396.942154:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740396.942197:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740396.942392:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133066368 00000100:00100000:1.0:1790740396.942401:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133066368 00000100:00100000:1.0:1790740396.942478:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 124 00000100:00100000:1.0:1790740396.942489:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1b6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+5:2371:x1877727133066368:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:1.0:1790740396.942602:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1b6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+5:2371:x1877727133066368:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 114us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740396.942628:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 124 00000100:00100000:0.0:1790740396.943276:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133066240 00000100:00100000:0.0:1790740396.943283:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133066240 00000100:00100000:0.0:1790740396.943333:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 284 00000100:00100000:0.0:1790740396.943341:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83feec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:2371:x1877727133066240:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:0.0:1790740396.943376:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83feec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:2371:x1877727133066240:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 37us (1232us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740396.943382:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 284 00000100:00080000:3.0:1790740396.947521:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790740396.957820:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740396.957980:0:8460:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133066496 00000100:00100000:2.0:1790740396.957990:0:8460:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133066496 00000100:00100000:2.0:1790740396.958126:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 19 00000100:00100000:2.0:1790740396.958136:0:8460:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec599375-3198-45fd-a23a-c5620f07177c+5:2368:x1877727133066496:12345-192.168.203.58@tcp:9:kworker.0 00000020:00000080:2.0:1790740396.958166:0:8460:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc6b31a1b598e9dbb 00000100:00080000:2.0:1790740396.958176:0:8460:0:(import.c:65:import_set_state_nolock()) ffff8f0d83f22000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790740396.958221:0:8460:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00080000:0.0:1790740396.958551:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1790740396.958607:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740396.959409:0:8460:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec599375-3198-45fd-a23a-c5620f07177c+2:2368:x1877727133066496:12345-192.168.203.58@tcp:9:kworker.0 Request processed in 1270us (1594us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740396.959419:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 19 00000100:00100000:3.0:1790740396.962812:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740396.962982:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133066624 00000100:00100000:1.0:1790740396.962993:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133066624 00000100:00100000:1.0:1790740396.963062:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 125 00000100:00100000:1.0:1790740396.963073:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+5:2372:x1877727133066624:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:1.0:1790740396.963165:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+5:2372:x1877727133066624:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 94us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740396.963173:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 125 00000100:00080000:0.0:1790740396.965655:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790740397.361245:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790740397.361266:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbee2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158268288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790740397.361475:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740397.361696:0:6703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158268288 00000100:00100000:3.0:1790740397.361704:0:6703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158268288 00000100:00100000:3.0:1790740397.361763:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790740397.361773:0:6703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1b6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158268288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790740397.361807:0:6703:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790740397.361853:0:6703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1b6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158268288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740397.361859:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:2.0:1790740397.362030:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dbee2d500 x1877727158268288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740413 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740397.362057:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbee2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158268288:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790740397.365252:0:11661:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740398.385184:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1790740398.445868:0:7642:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ec599375-3198-45fd-a23a-c5620f07177c 00000020:00000080:3.0:1790740398.445878:0:7642:0:(genops.c:885:class_export_put()) final put ffff8f0d83f25800/ec599375-3198-45fd-a23a-c5620f07177c 00000020:00000080:2.0:1790740398.446277:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff8f0d83f25800/ec599375-3198-45fd-a23a-c5620f07177c for lustre-OST0001 00000020:00000080:2.0:1790740398.446343:0:476:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f0d83f22000 for lustre-OST0001 00010000:00010000:2.0:1790740399.419479:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740400.437458:0:11661:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790740401.331191:0:11679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1790740401.465785:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbee2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3303:1877727158268416:0@lo:400:kworker.0 00000100:00100000:1.0:1790740401.466201:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbee2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877727158268544:0@lo:400:kworker.0 00000100:00100000:1.0:1790740401.466265:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740401.466423:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbee2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158269056:0@lo:400:kworker.0 00000100:00100000:1.0:1790740401.466450:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740401.466491:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbee2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158268800:0@lo:400:kworker.0 00000100:00100000:1.0:1790740401.466515:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740401.466536:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790740401.466542:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbee2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1877727158268672:0@lo:400:kworker.0 00000100:00100000:1.0:1790740401.466563:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740401.466606:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158268544 00000100:00100000:1.0:1790740401.466614:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158268544 00000100:00100000:1.0:1790740401.466652:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158268672 00000100:00100000:1.0:1790740401.466656:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158268672 00000100:00100000:1.0:1790740401.466683:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1790740401.466691:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877727158268544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740401.466886:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877727158268544:12345-0@lo:400:kworker.0 Request processed in 195us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740401.466909:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1790740401.467028:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1790740401.467035:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d84916680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877727158268672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740401.467257:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d84916680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877727158268672:12345-0@lo:400:kworker.0 Request processed in 221us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740401.467264:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1790740401.467297:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158269056 00000100:00100000:1.0:1790740401.467302:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158269056 00000100:00100000:1.0:1790740401.467328:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158268800 00000100:00100000:1.0:1790740401.467331:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158268800 00000100:00100000:1.0:1790740401.467352:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790740401.467359:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d84916300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158269056:12345-0@lo:400:kworker.0 00010000:00010000:2.0:1790740401.467427:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790740401.474545:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790740401.474554:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790740401.474557:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790740401.474615:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1790740401.474634:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d84916d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1877727158268800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740401.475966:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740401.476004:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158268416 00000100:00100000:3.0:1790740401.476013:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158268416 00000100:00100000:3.0:1790740401.476057:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1790740401.476065:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83fee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3303:x1877727158268416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740401.476124:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83fee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3303:x1877727158268416:12345-0@lo:400:kworker.0 Request processed in 59us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740401.476131:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1790740401.476198:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbee2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3303:1877727158268416:0@lo:400:kworker.0 00000100:00100000:3.0:1790740401.476212:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbee2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1877727158268928:0@lo:400:kworker.0 00000100:00100000:3.0:1790740401.476243:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740401.476304:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158268928 00000100:00100000:3.0:1790740401.476309:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158268928 00000100:00100000:3.0:1790740401.476345:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1790740401.476352:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877727158268928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740401.476386:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877727158268928:12345-0@lo:400:kworker.0 Request processed in 35us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740401.476392:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1790740401.476419:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbee2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1877727158268928:0@lo:400:kworker.0 00000100:00100000:1.0:1790740401.478874:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d84916300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158269056:12345-0@lo:400:kworker.0 Request processed in 11437us (12344us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740401.478890:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790740401.479043:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbee2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877727158268544:0@lo:400:kworker.0 00000100:00100000:1.0:1790740401.479059:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbee2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158269056:0@lo:400:kworker.0 00000100:00100000:1.0:1790740401.479103:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbee2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1877727158268672:0@lo:400:kworker.0 00000100:00080000:2.0:1790740401.483485:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790740401.483903:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d84916d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1877727158268800:12345-0@lo:400:kworker.0 Request processed in 9271us (17380us total) trans 0 rc 0/0 00010000:00080000:1.0:1790740401.484029:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dbee2f100 x1877727158268800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740401.484046:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbee2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158268800:0@lo:400:kworker.0 00000100:00100000:0.0:1790740401.484105:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1790740401.969561:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790740401.969613:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1b6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158269184:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790740401.969691:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740401.969900:0:6703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158269184 00000100:00100000:2.0:1790740401.969909:0:6703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158269184 00000100:00100000:2.0:1790740401.972738:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790740401.972766:0:6703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d84917100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877727158269184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790740401.972808:0:6703:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790740401.972918:0:6703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d84917100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877727158269184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 165us (3226us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740401.972925:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1790740401.973039:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1b6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158269184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790740402.060909:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740402.060954:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740402.060972:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133066752 00000100:00100000:2.0:1790740402.060983:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133066752 00000100:00100000:0.0:1790740402.061015:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740402.061054:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 286 00000100:00100000:2.0:1790740402.061064:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83fecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:2372:x1877727133066752:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:2.0:1790740402.061366:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83fecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:2372:x1877727133066752:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 303us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740402.061374:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 286 00000100:00100000:3.0:1790740402.068949:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133067008 00000100:00100000:3.0:1790740402.068964:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133067008 00000100:00100000:3.0:1790740402.069119:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133066880 00000100:00100000:3.0:1790740402.069123:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133066880 00000100:00100000:0.0:1790740402.069176:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 129 00000100:00100000:0.0:1790740402.069187:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d87e23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+5:2372:x1877727133067008:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:0.0:1790740402.069262:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d87e23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+5:2372:x1877727133067008:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 77us (8309us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740402.069269:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 129 00000100:00080000:2.0:1790740402.078703:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790740402.079182:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 130 00000100:00100000:3.0:1790740402.079196:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1290700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+5:2372:x1877727133066880:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:3.0:1790740402.079292:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1290700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+5:2372:x1877727133066880:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 100us (18276us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740402.079301:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 130 00000100:00100000:2.0:1790740402.482429:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790740402.482450:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbee2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158269312:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790740402.482511:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740402.485937:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158269312 00000100:00100000:1.0:1790740402.485951:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158269312 00000100:00100000:1.0:1790740402.486010:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790740402.486019:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1b6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158269312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790740402.486057:0:6704:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790740402.486210:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1b6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158269312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 189us (3695us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740402.486217:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00010000:1.0:1790740402.486291:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:0.0:1790740402.486386:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dbee2fb80 x1877727158269312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740418 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740402.486408:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbee2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158269312:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1790740403.046308:0:11842:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 23:53:21 (1790740401) 00010000:00010000:2.0:1790740403.506076:0:11661:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740404.528788:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740405.300492:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740405.300656:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133067136 00000100:00100000:3.0:1790740405.300665:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133067136 00000100:00100000:3.0:1790740405.300789:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 32 00000100:00100000:3.0:1790740405.300801:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1291f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+5:10232:x1877727133067136:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790740405.300822:0:8666:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740405.300845:0:8666:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fe00/0xc6b31a1b598e9e86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee42a expref: -99 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740405.300909:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598e9e8d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740405.300923:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598e9e8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740405.300937:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598e9e8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790740405.300975:0:8666:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790740405.300979:0:8666:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790740405.301016:0:8666:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598e9e8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740405.301040:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fe00/0xc6b31a1b598e9e86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee42a expref: 7 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740405.301059:0:8666:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598e9e8d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee42a expref: 6 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740405.301067:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0d944f6200) 00010000:00010000:3.0:1790740405.301082:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790740405.301086:0:8666:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0db6c0e600, rc 0) 00000100:00100000:3.0:1790740405.301150:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1291f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+6:10232:x1877727133067136:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 Request processed in 351us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740405.301157:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 32 00000100:00080000:2.0:1790740405.311549:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790740405.323518:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740405.323616:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133067264 00000100:00100000:1.0:1790740405.323626:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133067264 00000100:00100000:1.0:1790740405.323688:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 33 00000100:00100000:1.0:1790740405.323698:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1292a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+6:10233:x1877727133067264:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790740405.323721:0:5842:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740405.323742:0:5842:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598e9e94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee431 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740405.323812:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598e9e9b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740405.323828:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598e9e9b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740405.323840:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598e9e9b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740405.323855:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598e9ea2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740405.323862:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598e9ea2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740405.323885:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598e9ea2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740405.324088:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976a00/0xc6b31a1b598e9ea9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740405.324098:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976a00/0xc6b31a1b598e9ea9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740405.324105:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976a00/0xc6b31a1b598e9ea9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790740405.324131:0:5842:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790740405.324135:0:5842:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790740405.324153:0:5842:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976a00/0xc6b31a1b598e9ea9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740405.324163:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598e9e9b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740405.324170:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598e9e9b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740405.324177:0:5842:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598e9e9b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740405.324183:0:5842:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f976000 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1790740405.324187:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598e9e9b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740405.324194:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598e9e9b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740405.324332:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0d944f6200) 00010000:00010000:1.0:1790740405.324336:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740405.324342:0:5842:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598e9e9b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740405.324349:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598e9e9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740405.324366:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598e9ea2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740405.324372:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598e9ea2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740405.324378:0:5842:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598e9ea2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740405.324383:0:5842:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f976600 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1790740405.324386:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598e9ea2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740405.324392:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598e9ea2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740405.324400:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8f0d84a1ea00) 00010000:00010000:1.0:1790740405.324402:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740405.324405:0:5842:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598e9ea2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740405.324411:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598e9ea2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740405.324453:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598e9e94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee431 expref: 8 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740405.324469:0:5842:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976a00/0xc6b31a1b598e9ea9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee431 expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740405.324490:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8f0d84a1e500) 00010000:00010000:1.0:1790740405.324493:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790740405.324495:0:5842:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9f976a00, rc 0) 00000100:00100000:1.0:1790740405.324567:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1292a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+7:10233:x1877727133067264:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 Request processed in 870us (1060us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740405.324838:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 33 00000100:00100000:0.0:1790740405.347876:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740405.347960:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133067520 00000100:00100000:3.0:1790740405.347970:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133067520 00000100:00100000:3.0:1790740405.348038:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 34 00000100:00100000:3.0:1790740405.348049:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+7:10233:x1877727133067520:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790740405.348069:0:8666:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740405.348089:0:8666:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fe00/0xc6b31a1b598e9eb0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee438 expref: -99 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740405.348169:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fa00/0xc6b31a1b598e9eb7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740405.348183:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fa00/0xc6b31a1b598e9eb7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740405.348194:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fa00/0xc6b31a1b598e9eb7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740405.348227:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fc00/0xc6b31a1b598e9ebe lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740405.348235:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fc00/0xc6b31a1b598e9ebe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740405.348243:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fc00/0xc6b31a1b598e9ebe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740405.348680:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e400/0xc6b31a1b598e9ec5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740405.348691:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e400/0xc6b31a1b598e9ec5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740405.348700:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e400/0xc6b31a1b598e9ec5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790740405.348710:0:8666:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1790740405.348881:0:8666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fa00/0xc6b31a1b598e9eb7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740405.348890:0:8666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fa00/0xc6b31a1b598e9eb7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740405.348898:0:8666:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fa00/0xc6b31a1b598e9eb7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740405.348904:0:8666:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0fa00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1790740405.348909:0:8666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fa00/0xc6b31a1b598e9eb7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740405.348916:0:8666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fa00/0xc6b31a1b598e9eb7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740405.348927:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8f0d84a1e500) 00010000:00010000:3.0:1790740405.348930:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740405.348935:0:8666:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fa00/0xc6b31a1b598e9eb7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740405.348952:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fa00/0xc6b31a1b598e9eb7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740405.348965:0:8666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fc00/0xc6b31a1b598e9ebe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740405.348972:0:8666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fc00/0xc6b31a1b598e9ebe lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740405.348978:0:8666:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fc00/0xc6b31a1b598e9ebe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740405.348983:0:8666:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0fc00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1790740405.348986:0:8666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fc00/0xc6b31a1b598e9ebe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740405.348993:0:8666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fc00/0xc6b31a1b598e9ebe lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740405.349001:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8f0d944f6d00) 00010000:00010000:3.0:1790740405.349004:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740405.349006:0:8666:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fc00/0xc6b31a1b598e9ebe lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740405.349013:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fc00/0xc6b31a1b598e9ebe lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740405.349471:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fe00/0xc6b31a1b598e9eb0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee438 expref: 10 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740405.349487:0:8666:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e400/0xc6b31a1b598e9ec5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee438 expref: 9 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740405.349502:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f0d944f6600) 00010000:00010000:3.0:1790740405.349504:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740405.349507:0:8666:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0db6c0e400, rc 0) 00000100:00100000:3.0:1790740405.349980:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+9:10233:x1877727133067520:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 Request processed in 1930us (2112us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1790740405.349989:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 34 00000100:00100000:1.0:1790740405.367852:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740405.368558:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133067648 00000100:00100000:2.0:1790740405.368569:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133067648 00000100:00100000:2.0:1790740405.368773:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 35 00000100:00100000:2.0:1790740405.368793:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d84917b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+9:10233:x1877727133067648:12345-192.168.203.58@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1790740405.368905:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d84917b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+9:10233:x1877727133067648:12345-192.168.203.58@tcp:59:lhsmtool_posix.0 Request processed in 113us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740405.368913:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 35 00000040:00080000:2.0:1790740405.427496:0:11679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790740405.552927:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740406.578608:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbee2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877727158269568:0@lo:400:kworker.0 00000100:00100000:1.0:1790740406.578675:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740406.578726:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790740406.578731:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbee2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3304:1877727158269440:0@lo:400:kworker.0 00000100:00100000:1.0:1790740406.578758:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740406.578790:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158269568 00000100:00100000:1.0:1790740406.578797:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158269568 00000100:00100000:1.0:1790740406.578844:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1790740406.578852:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d84916a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877727158269568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740406.578903:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d84916a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877727158269568:12345-0@lo:400:kworker.0 Request processed in 51us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740406.578909:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1790740406.578943:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158269440 00000100:00100000:1.0:1790740406.578947:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158269440 00000100:00100000:1.0:1790740406.578967:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1790740406.578973:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83fec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3304:x1877727158269440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740406.579017:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83fec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3304:x1877727158269440:12345-0@lo:400:kworker.0 Request processed in 44us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740406.579023:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1790740406.579068:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbee2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3304:1877727158269440:0@lo:400:kworker.0 00000100:00100000:1.0:1790740406.579082:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbee2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877727158269568:0@lo:400:kworker.0 00010000:00010000:1.0:1790740406.579157:0:11661:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740406.593801:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbee2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1877727158269696:0@lo:400:kworker.0 00000100:00100000:0.0:1790740406.593953:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740406.594327:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158269696 00000100:00100000:1.0:1790740406.594336:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158269696 00000100:00100000:1.0:1790740406.594403:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1790740406.594413:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1291500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877727158269696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740406.594480:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1291500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877727158269696:12345-0@lo:400:kworker.0 Request processed in 68us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740406.594487:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:2.0:1790740406.594635:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790740406.594974:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbee2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1877727158269696:0@lo:400:kworker.0 00000100:00100000:1.0:1790740406.595204:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790740406.595256:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790740406.595267:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbee2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1877727158269952:0@lo:400:kworker.0 00000100:00100000:3.0:1790740406.595299:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740406.595325:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158269952 00000100:00100000:3.0:1790740406.595328:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158269952 00000100:00100000:3.0:1790740406.595496:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1790740406.595504:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1877727158269952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740406.595556:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1877727158269952:12345-0@lo:400:kworker.0 Request processed in 54us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740406.595563:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1790740406.595629:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbee2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1877727158269952:0@lo:400:kworker.0 00000100:00080000:3.0:1790740406.595644:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790740406.595684:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbee2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158270080:0@lo:400:kworker.0 00000100:00100000:3.0:1790740406.595710:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740406.595738:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158270080 00000100:00100000:3.0:1790740406.595742:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158270080 00000100:00100000:3.0:1790740406.595773:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790740406.595779:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158270080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740406.595844:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158270080:12345-0@lo:400:kworker.0 Request processed in 54us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740406.595852:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790740406.595885:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbee2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158270080:0@lo:400:kworker.0 00000100:00080000:3.0:1790740406.595899:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790740406.605023:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbee2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158269824:0@lo:400:kworker.0 00000100:00100000:1.0:1790740406.605088:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740406.605139:0:8460:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158269824 00000100:00100000:1.0:1790740406.605146:0:8460:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158269824 00000100:00100000:1.0:1790740406.605196:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1790740406.605205:0:8460:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d84917480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158269824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740406.605272:0:8460:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d84917480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158269824:12345-0@lo:400:kworker.0 Request processed in 68us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740406.605293:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:1.0:1790740406.605320:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790740406.605348:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dbee2c000 x1877727158269824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790740422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740406.605362:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbee2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158269824:0@lo:400:kworker.0 00000100:00100000:1.0:1790740407.090386:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1b6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158270208:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790740407.090455:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740407.090611:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158270208 00000100:00100000:3.0:1790740407.090620:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158270208 00000100:00100000:3.0:1790740407.090668:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1790740407.090678:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d98513b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158270208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790740407.090709:0:6704:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790740407.105315:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d98513b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158270208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 14629us (14850us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740407.105329:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1790740407.108512:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1b6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158270208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790740407.181017:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740407.181067:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740407.181110:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740407.181168:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133067904 00000100:00100000:2.0:1790740407.181183:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133067904 00000100:00100000:2.0:1790740407.181264:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133068032 00000100:00100000:2.0:1790740407.181268:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133068032 00000100:00100000:2.0:1790740407.181292:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 134 00000100:00100000:2.0:1790740407.181301:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+9:2369:x1877727133067904:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:2.0:1790740407.181375:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+9:2369:x1877727133067904:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 75us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740407.181382:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 134 00000100:00100000:2.0:1790740407.181398:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 135 00000100:00100000:2.0:1790740407.181405:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+5:2369:x1877727133068032:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:2.0:1790740407.181429:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+5:2369:x1877727133068032:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 24us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740407.181435:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 135 00000100:00100000:2.0:1790740407.181452:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133067776 00000100:00100000:2.0:1790740407.181455:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133067776 00000100:00100000:2.0:1790740407.181479:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 288 00000100:00100000:2.0:1790740407.181485:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83fef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:2369:x1877727133067776:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:2.0:1790740407.181509:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83fef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:2369:x1877727133067776:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 24us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740407.181516:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 288 00000100:00080000:3.0:1790740407.181887:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790740407.506081:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740407.506164:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133068160 00000100:00100000:2.0:1790740407.506173:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133068160 00000100:00100000:2.0:1790740407.506230:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 36 00000100:00100000:2.0:1790740407.506249:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+9:10276:x1877727133068160:12345-192.168.203.58@tcp:101:lfs.0 00010000:00010000:2.0:1790740407.506309:0:5843:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740407.506329:0:5843:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598e9ed3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee43f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.506396:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595a00/0xc6b31a1b598e9eda lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.506410:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595a00/0xc6b31a1b598e9eda lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.506422:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595a00/0xc6b31a1b598e9eda lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.506436:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598e9ee1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.506442:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598e9ee1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.506448:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598e9ee1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.506696:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595a00/0xc6b31a1b598e9eda lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.506705:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595a00/0xc6b31a1b598e9eda lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.506712:0:5843:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595a00/0xc6b31a1b598e9eda lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.506718:0:5843:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87595a00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740407.506723:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595a00/0xc6b31a1b598e9eda lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.506738:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595a00/0xc6b31a1b598e9eda lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.506750:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0d944f6200) 00010000:00010000:2.0:1790740407.506753:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740407.506758:0:5843:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595a00/0xc6b31a1b598e9eda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.506764:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595a00/0xc6b31a1b598e9eda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.506774:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598e9ee1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.506779:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598e9ee1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.506785:0:5843:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598e9ee1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.506790:0:5843:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87595c00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740407.506793:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598e9ee1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.506799:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598e9ee1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.506806:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8f0d98dccb00) 00010000:00010000:2.0:1790740407.506808:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740407.506811:0:5843:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598e9ee1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.506826:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598e9ee1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.506855:0:5843:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598e9ed3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee43f expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.506864:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0d944f6200) 00010000:00010000:2.0:1790740407.506866:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740407.506869:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598e9ed3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee43f expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.506877:0:5843:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d87595400, rc 0) 00000100:00100000:2.0:1790740407.506934:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+9:10276:x1877727133068160:12345-192.168.203.58@tcp:101:lfs.0 Request processed in 697us (863us total) trans 0 rc 301/301 00000100:00100000:2.0:1790740407.506941:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 36 00000100:00100000:1.0:1790740407.510849:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740407.511039:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133068416 00000100:00100000:2.0:1790740407.511049:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133068416 00000100:00100000:2.0:1790740407.511150:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 37 00000100:00100000:2.0:1790740407.511160:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d98511c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+9:10276:x1877727133068416:12345-192.168.203.58@tcp:36:lfs.0 00010000:00010000:2.0:1790740407.511213:0:5844:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740407.511248:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598e9e8d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee42a expref: 9 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.511268:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0d944f6200) 00010000:00010000:2.0:1790740407.511278:0:5844:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790740407.511473:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598e9ee8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.511508:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598e9ee8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.511519:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598e9ee8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.511533:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598e9eef lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.511540:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598e9eef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.511547:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598e9eef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740407.512412:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1790740407.512423:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598e9ee8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.512433:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598e9ee8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.512440:0:5844:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598e9ee8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.512446:0:5844:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87594400 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740407.512451:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598e9ee8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.512458:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598e9ee8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.512477:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0d98dcc600) 00010000:00010000:2.0:1790740407.512480:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740407.512484:0:5844:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598e9ee8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.512491:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598e9ee8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790740407.512505:0:5844:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000003c55b473 reply state 000000005adb618f transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598e9eef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740407.512513:0:5844:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790740407.512629:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d98511c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+10:10276:x1877727133068416:12345-192.168.203.58@tcp:36:lfs.0 Request processed in 1468us (1785us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1790740407.512637:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 37 00010000:00010000:0.0:1790740407.518809:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598e9eef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740407.518841:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598e9eef lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740407.518850:0:3289:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598e9eef lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740407.518857:0:3289:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87594e00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1790740407.518862:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598e9eef lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740407.518871:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598e9eef lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740407.518887:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8f0d98dcc700) 00010000:00010000:0.0:1790740407.518891:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740407.518896:0:3289:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598e9eef lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740407.518902:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598e9eef lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740407.601652:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790740407.601748:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d98511180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158270336:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790740407.602636:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740407.603634:0:6703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158270336 00000100:00100000:3.0:1790740407.603645:0:6703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158270336 00000100:00100000:3.0:1790740407.603838:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790740407.603848:0:6703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d98510a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158270336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790740407.603888:0:6703:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790740407.603953:0:6703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d98510a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158270336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (1319us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740407.603960:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:0.0:1790740407.604056:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0d98511180 x1877727158270336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740423 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740407.604078:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d98511180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158270336:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1790740407.604281:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740407.631165:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740407.631297:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133068544 00000100:00100000:3.0:1790740407.631320:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133068544 00000100:00100000:3.0:1790740407.631381:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 38 00000100:00100000:3.0:1790740407.631391:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d98510700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+9:10284:x1877727133068544:12345-192.168.203.58@tcp:101:lctl.0 00010000:00010000:3.0:1790740407.631415:0:5842:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740407.631437:0:5842:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fc00/0xc6b31a1b598e9ef6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee446 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740407.631500:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fe00/0xc6b31a1b598e9efd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740407.631514:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fe00/0xc6b31a1b598e9efd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740407.631526:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fe00/0xc6b31a1b598e9efd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790740407.631560:0:5842:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790740407.631564:0:5842:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790740407.631642:0:5842:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fe00/0xc6b31a1b598e9efd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740407.631667:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fc00/0xc6b31a1b598e9ef6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee446 expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740407.631685:0:5842:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fe00/0xc6b31a1b598e9efd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee446 expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740407.631695:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0d944f6d00) 00010000:00010000:3.0:1790740407.631698:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790740407.631702:0:5842:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0db6c0fe00, rc 0) 00000100:00100000:3.0:1790740407.632004:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d98510700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+10:10284:x1877727133068544:12345-192.168.203.58@tcp:101:lctl.0 Request processed in 614us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740407.632013:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 38 00000100:00100000:3.0:1790740407.733646:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740407.733857:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133068672 00000100:00100000:2.0:1790740407.733868:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133068672 00000100:00100000:2.0:1790740407.733934:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 39 00000100:00100000:2.0:1790740407.733944:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+10:10290:x1877727133068672:12345-192.168.203.58@tcp:101:bash.0 00010000:00010000:2.0:1790740407.733963:0:8666:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740407.733983:0:8666:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598e9f04 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee44d expref: -99 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.734047:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598e9f0b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.734061:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598e9f0b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.734091:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598e9f0b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.734108:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598e9f12 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.734115:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598e9f12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.734122:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598e9f12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.734213:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595a00/0xc6b31a1b598e9f19 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.734222:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595a00/0xc6b31a1b598e9f19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.734228:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595a00/0xc6b31a1b598e9f19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740407.734265:0:8666:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1790740407.734269:0:8666:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790740407.734304:0:8666:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595a00/0xc6b31a1b598e9f19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.734427:0:8666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598e9f0b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.734436:0:8666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598e9f0b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.734453:0:8666:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598e9f0b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.734469:0:8666:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87595400 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740407.734473:0:8666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598e9f0b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.734481:0:8666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598e9f0b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.734499:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0d944f6d00) 00010000:00010000:2.0:1790740407.734503:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740407.734508:0:8666:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598e9f0b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.734513:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598e9f0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.734526:0:8666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598e9f12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.734531:0:8666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598e9f12 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.734536:0:8666:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598e9f12 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.734540:0:8666:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87595c00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740407.734544:0:8666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598e9f12 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.734557:0:8666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598e9f12 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.734565:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8f0d98dcc600) 00010000:00010000:2.0:1790740407.734568:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740407.734606:0:8666:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598e9f12 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.734612:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598e9f12 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.734642:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598e9f04 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee44d expref: 12 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.734654:0:8666:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595a00/0xc6b31a1b598e9f19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee44d expref: 11 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.734660:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f0d98dccb00) 00010000:00010000:2.0:1790740407.734662:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1790740407.734664:0:8666:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d87595a00, rc 0) 00000100:00100000:2.0:1790740407.734985:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+11:10290:x1877727133068672:12345-192.168.203.58@tcp:101:bash.0 Request processed in 1041us (1352us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740407.734994:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 39 00000100:00100000:0.0:1790740407.748680:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740407.748844:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133068928 00000100:00100000:2.0:1790740407.748853:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133068928 00000100:00100000:2.0:1790740407.748907:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 40 00000100:00100000:2.0:1790740407.748916:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1292d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+11:10290:x1877727133068928:12345-192.168.203.58@tcp:101:bash.0 00010000:00010000:2.0:1790740407.748948:0:5843:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740407.748968:0:5843:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598e9f20 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee454 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.749082:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594600/0xc6b31a1b598e9f27 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.749096:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594600/0xc6b31a1b598e9f27 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.749108:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594600/0xc6b31a1b598e9f27 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.749173:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598e9f2e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.749182:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598e9f2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.749188:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598e9f2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790740407.749789:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:2.0:1790740407.749948:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598e9f35 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.749958:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598e9f35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.749966:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598e9f35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.750010:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594600/0xc6b31a1b598e9f27 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.750018:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594600/0xc6b31a1b598e9f27 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.750023:0:5843:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594600/0xc6b31a1b598e9f27 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.750029:0:5843:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87594600 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740407.750033:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594600/0xc6b31a1b598e9f27 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.750040:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594600/0xc6b31a1b598e9f27 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.750052:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f0d98dccb00) 00010000:00010000:2.0:1790740407.750055:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740407.750059:0:5843:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594600/0xc6b31a1b598e9f27 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.750066:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594600/0xc6b31a1b598e9f27 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790740407.750079:0:5843:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000008ec43839 reply state 0000000061c20bcc transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598e9f2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740407.750087:0:5843:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1790740407.750115:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598e9f20 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee454 expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.750141:0:5843:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598e9f35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee454 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.750148:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f0d98dcc900) 00010000:00010000:2.0:1790740407.750151:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790740407.750153:0:5843:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d87594e00, rc 0) 00000100:00100000:2.0:1790740407.750230:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1292d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+14:10290:x1877727133068928:12345-192.168.203.58@tcp:101:bash.0 Request processed in 1314us (1558us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1790740407.750248:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 40 00010000:00010000:3.0:1790740407.752677:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598e9f2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740407.752704:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598e9f2e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740407.752718:0:3290:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598e9f2e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740407.752724:0:3290:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87594000 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1790740407.752729:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598e9f2e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740407.752735:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598e9f2e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740407.752750:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8f0d98dcc000) 00010000:00010000:3.0:1790740407.752753:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740407.752757:0:3290:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598e9f2e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740407.752764:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598e9f2e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740407.762068:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740407.762277:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133069056 00000100:00100000:3.0:1790740407.762343:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133069056 00000100:00100000:3.0:1790740407.762395:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 20 00000100:00100000:3.0:1790740407.762404:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1292680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2368:x1877727133069056:12345-192.168.203.58@tcp:8:bash.0 00010000:00080000:3.0:1790740407.762450:0:6701:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from ec599375-3198-45fd-a23a-c5620f07177c@192.168.203.58@tcp t0 exp 0000000000000000 cur 323 last 0 00000020:00000080:3.0:1790740407.762496:0:6701:0:(genops.c:1384:class_connect()) connect: client ec599375-3198-45fd-a23a-c5620f07177c, cookie 0xc6b31a1b598e9f43 00002000:00100000:3.0:1790740407.762508:0:6701:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ec599375-3198-45fd-a23a-c5620f07177c/ffff8f0d981af800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b03 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1790740407.762519:0:6701:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1790740407.762755:0:6701:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1790740407.762786:0:6701:0:(import.c:65:import_set_state_nolock()) ffff8f0d981ae000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790740407.762855:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1292680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec599375-3198-45fd-a23a-c5620f07177c+6:2368:x1877727133069056:12345-192.168.203.58@tcp:8:bash.0 Request processed in 450us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740407.762863:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 20 00000100:00100000:1.0:1790740407.765858:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740407.766941:0:8460:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133069184 00000100:00100000:2.0:1790740407.766954:0:8460:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133069184 00000100:00100000:2.0:1790740407.767034:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 21 00000100:00100000:2.0:1790740407.767045:0:8460:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d98511180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec599375-3198-45fd-a23a-c5620f07177c+6:0:x1877727133069184:12345-192.168.203.58@tcp:101:bash.0 00010000:00010000:2.0:1790740407.767062:0:8460:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740407.767089:0:8460:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004ba155b/0xc6b31a1b598e9f4a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee45b expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790740407.767115:0:8460:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790740407.767132:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=323s v=(0 0) 00010000:00010000:2.0:1790740407.767137:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790740407.767146:0:8460:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004ba155b/0xc6b31a1b598e9f4a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee45b expref: 7 pid: 8460 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1790740407.767390:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790740407.767420:0:8460:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000004ba155b/0xc6b31a1b598e9f4a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee45b expref: 7 pid: 8460 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.767450:0:8460:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d87594400, rc 0) 00000100:00100000:2.0:1790740407.767516:0:8460:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d98511180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec599375-3198-45fd-a23a-c5620f07177c+7:0:x1877727133069184:12345-192.168.203.58@tcp:101:bash.0 Request processed in 473us (1665us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740407.767524:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 21 00000100:00100000:0.0:1790740407.778632:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740407.778785:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133069312 00000100:00100000:3.0:1790740407.778795:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133069312 00000100:00100000:3.0:1790740407.778850:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 22 00000100:00100000:3.0:1790740407.778860:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1293100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec599375-3198-45fd-a23a-c5620f07177c+7:10290:x1877727133069312:12345-192.168.203.58@tcp:101:bash.0 00010000:00010000:3.0:1790740407.778878:0:6699:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740407.778898:0:6699:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba19b8fc/0xc6b31a1b598e9f51 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee462 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740407.778928:0:6699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000004ba155b/0xc6b31a1b598e9f4a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee45b expref: 8 pid: 8460 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740407.778936:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790740407.778939:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790740407.778944:0:6699:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba19b8fc/0xc6b31a1b598e9f51 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee462 expref: 8 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740407.778995:0:6699:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000004ba155b/0xc6b31a1b598e9f4a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee45b expref: 8 pid: 8460 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740407.779009:0:6699:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000004ba155b/0xc6b31a1b598e9f4a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee45b expref: 8 pid: 8460 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740407.779023:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbee2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6699:1877727158270464:192.168.203.58@tcp:104: 00000100:00100000:3.0:1790740407.779129:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0db6f3bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1790740407.784088:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740407.784196:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbee2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6699:1877727158270464:192.168.203.58@tcp:104: 00010000:00010000:3.0:1790740407.784228:0:6699:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ba19b8fc/0xc6b31a1b598e9f51 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee462 expref: 8 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740407.784261:0:6699:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0db6c0fc00, rc 0) 00000100:00100000:3.0:1790740407.784320:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1293100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec599375-3198-45fd-a23a-c5620f07177c+8:10290:x1877727133069312:12345-192.168.203.58@tcp:101:bash.0 Request processed in 5461us (5697us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740407.784329:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 22 00000100:00100000:2.0:1790740407.785351:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133069440 00000100:00100000:2.0:1790740407.785361:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133069440 00010000:00010000:2.0:1790740407.785395:0:5829:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000004ba155b/0xc6b31a1b598e9f4a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee45b expref: 8 pid: 8460 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740407.785433:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 35 00000100:00100000:2.0:1790740407.785442:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8812ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec599375-3198-45fd-a23a-c5620f07177c+8:2370:x1877727133069440:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790740407.785454:0:5829:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740407.785481:0:5829:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000004ba155b/0xc6b31a1b598e9f4a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee45b expref: 8 pid: 8460 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.785677:0:5829:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000004ba155b/0xc6b31a1b598e9f4a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee45b expref: 8 pid: 8460 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.785707:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004ba155b/0xc6b31a1b598e9f4a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee45b expref: 8 pid: 8460 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.785723:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790740407.785728:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790740407.785736:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba19b8fc/0xc6b31a1b598e9f51 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee462 expref: 7 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.785772:0:5829:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba19b8fc/0xc6b31a1b598e9f51 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee462 expref: 7 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740407.785811:0:5829:0:(ldlm_lockd.c:1085:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ba19b8fc/0xc6b31a1b598e9f51 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee462 expref: 7 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740407.785826:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1b6c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5829:1877727158270592:192.168.203.58@tcp:105: 00000100:00100000:2.0:1790740407.785903:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d8956f240 going to sleep for 11 seconds 00000100:00100000:3.0:1790740407.793524:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1b6c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5829:1877727158270592:192.168.203.58@tcp:105: 00010000:00010000:3.0:1790740407.793550:0:5829:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790740407.793633:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8812ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec599375-3198-45fd-a23a-c5620f07177c+7:2370:x1877727133069440:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 8191us (9554us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740407.793644:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 35 00000100:00100000:1.0:1790740407.795288:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740407.795795:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133069696 00000100:00100000:2.0:1790740407.795805:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133069696 00000100:00100000:2.0:1790740407.795863:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 6 00000100:00100000:2.0:1790740407.795873:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8812c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+13:10290:x1877727133069696:12345-192.168.203.58@tcp:35:bash.0 00000100:00100000:2.0:1790740407.796249:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8812c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+14:10290:x1877727133069696:12345-192.168.203.58@tcp:35:bash.0 Request processed in 377us (965us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1790740407.796258:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 6 00000100:00100000:0.0:1790740407.926680:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740407.927229:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133069952 00000100:00100000:3.0:1790740407.927251:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133069952 00000100:00100000:3.0:1790740407.927325:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 41 00000100:00100000:3.0:1790740407.927336:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+14:10300:x1877727133069952:12345-192.168.203.58@tcp:101:lfs.0 00010000:00010000:3.0:1790740407.927359:0:5844:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740407.927379:0:5844:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fa00/0xc6b31a1b598e9f58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee469 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790740407.927466:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1790740407.928089:0:5844:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fa00/0xc6b31a1b598e9f58 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee469 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740407.928106:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0d944f6d00) 00010000:00010000:3.0:1790740407.928110:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790740407.928115:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fa00/0xc6b31a1b598e9f58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee469 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740407.928131:0:5844:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0db6c0fa00, rc 0) 00000100:00100000:3.0:1790740407.928202:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+15:10300:x1877727133069952:12345-192.168.203.58@tcp:101:lfs.0 Request processed in 868us (1530us total) trans 4294967313 rc 301/301 00000100:00100000:3.0:1790740407.928211:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 41 00000100:00100000:1.0:1790740407.932940:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740407.933372:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133070208 00000100:00100000:2.0:1790740407.933383:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133070208 00000100:00100000:2.0:1790740407.933434:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 7 00000100:00100000:2.0:1790740407.933444:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8812f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+15:10300:x1877727133070208:12345-192.168.203.58@tcp:35:lfs.0 00000100:00100000:2.0:1790740407.933972:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8812f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+16:10300:x1877727133070208:12345-192.168.203.58@tcp:35:lfs.0 Request processed in 528us (1041us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1790740407.933978:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 7 00000100:00100000:1.0:1790740408.085821:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740408.085979:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133070336 00000100:00100000:2.0:1790740408.086002:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133070336 00000100:00100000:2.0:1790740408.086057:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 42 00000100:00100000:2.0:1790740408.086067:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8812ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+16:10306:x1877727133070336:12345-192.168.203.58@tcp:101:lfs.0 00010000:00010000:2.0:1790740408.086090:0:5843:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740408.086109:0:5843:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598e9f66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee470 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.086173:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594600/0xc6b31a1b598e9f6d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.086189:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594600/0xc6b31a1b598e9f6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.086203:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594600/0xc6b31a1b598e9f6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740408.086247:0:5843:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1790740408.086252:0:5843:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790740408.086270:0:5843:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594600/0xc6b31a1b598e9f6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.086297:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598e9f66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee470 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.086316:0:5843:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594600/0xc6b31a1b598e9f6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee470 expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.086325:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f0d98dccb00) 00010000:00010000:2.0:1790740408.086327:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790740408.086331:0:5843:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d87594600, rc 0) 00000100:00100000:2.0:1790740408.086399:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8812ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+17:10306:x1877727133070336:12345-192.168.203.58@tcp:101:lfs.0 Request processed in 332us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740408.086407:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 42 00000100:00100000:0.0:1790740408.117731:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740408.117824:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133070592 00000100:00100000:2.0:1790740408.117835:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133070592 00000100:00100000:2.0:1790740408.117912:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 43 00000100:00100000:2.0:1790740408.117922:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1292300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+17:10306:x1877727133070592:12345-192.168.203.58@tcp:101:lfs.0 00010000:00010000:2.0:1790740408.117941:0:8666:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740408.117962:0:8666:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598e9f74 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee477 expref: -99 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.118057:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598e9f7b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.118073:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598e9f7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.118085:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598e9f7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740408.118096:0:8666:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1790740408.118223:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598e9f74 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee477 expref: 20 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.118253:0:8666:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598e9f7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee477 expref: 19 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.118273:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f0d98dcc900) 00010000:00010000:2.0:1790740408.118275:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790740408.118293:0:8666:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d87595c00, rc 0) 00000100:00100000:2.0:1790740408.118356:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1292300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+19:10306:x1877727133070592:12345-192.168.203.58@tcp:101:lfs.0 Request processed in 435us (634us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1790740408.118364:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 43 00000100:00100000:1.0:1790740408.125531:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740408.125621:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740408.125828:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133070848 00000100:00100000:2.0:1790740408.125837:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133070848 00000100:00100000:2.0:1790740408.125908:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 44 00000100:00100000:2.0:1790740408.125918:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd03fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+19:10306:x1877727133070848:12345-192.168.203.58@tcp:101:lfs.0 00010000:00010000:2.0:1790740408.125941:0:5843:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740408.125963:0:5843:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598e9f89 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee47e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.126054:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598e9f90 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.126068:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598e9f90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.126078:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598e9f90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740408.126089:0:5843:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1790740408.126203:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598e9f89 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee47e expref: 22 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.126221:0:5843:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598e9f90 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee47e expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.126238:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f0d98dcc900) 00010000:00010000:2.0:1790740408.126255:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1790740408.126259:0:5843:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d87594800, rc 0) 00000100:00100000:2.0:1790740408.126320:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd03fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+21:10306:x1877727133070848:12345-192.168.203.58@tcp:101:lfs.0 Request processed in 404us (798us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1790740408.126327:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 44 00000100:00100000:3.0:1790740408.126491:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133070976 00000100:00100000:3.0:1790740408.126497:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133070976 00000100:00100000:3.0:1790740408.126536:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 2 00000100:00100000:3.0:1790740408.126544:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd03e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec599375-3198-45fd-a23a-c5620f07177c+21:2370:x1877727133070976:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790740408.126553:0:5828:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740408.126567:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598e9f7b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee477 expref: 21 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740408.126628:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f0d98dcc900) 00010000:00010000:3.0:1790740408.126632:0:5828:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790740408.126654:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd03e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec599375-3198-45fd-a23a-c5620f07177c+20:2370:x1877727133070976:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 111us (1033us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740408.126660:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 2 00000100:00100000:1.0:1790740408.138158:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740408.138261:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133071104 00000100:00100000:0.0:1790740408.138271:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133071104 00000100:00100000:0.0:1790740408.138325:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 23 00000100:00100000:0.0:1790740408.138335:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd03f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec599375-3198-45fd-a23a-c5620f07177c+7:2369:x1877727133071104:12345-192.168.203.58@tcp:1:lfs.0 00010000:00010000:0.0:1790740408.138378:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034db2d06/0xc6b31a1b598e9f9e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740408.138406:0:6700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba19b8fc/0xc6b31a1b598e9f51 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee462 expref: 7 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740408.138414:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1790740408.138419:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790740408.138423:0:6700:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034db2d06/0xc6b31a1b598e9f9e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740408.138457:0:6700:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ba19b8fc/0xc6b31a1b598e9f51 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee462 expref: 7 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740408.138469:0:6700:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ba19b8fc/0xc6b31a1b598e9f51 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee462 expref: 7 pid: 6699 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740408.138484:0:6700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1290380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6700:1877727158270720:192.168.203.58@tcp:104: 00000100:00100000:0.0:1790740408.138565:0:6700:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d87584e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790740408.140495:0:6700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1290380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6700:1877727158270720:192.168.203.58@tcp:104: 00010000:00010000:0.0:1790740408.140520:0:6700:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000034db2d06/0xc6b31a1b598e9f9e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740408.142779:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740408.142875:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133071232 00000100:00100000:3.0:1790740408.142884:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133071232 00002000:00100000:3.0:1790740408.142928:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff8f0dbd03c380 x1877727133071232/t0(0) o4->ec599375-3198-45fd-a23a-c5620f07177c@192.168.203.58@tcp:464/0 lens 504/0 e 0 to 0 dl 1790740419 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790740408.142939:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f0dbd03c380 with x1877727133071232 ext(0->12) 00010000:00010000:3.0:1790740408.142948:0:6705:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000ba19b8fc/0xc6b31a1b598e9f51 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee462 expref: 8 pid: 6699 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740408.142964:0:6705:0:(ldlm_lockd.c:610:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000ba19b8fc/0xc6b31a1b598e9f51 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee462 expref: 8 pid: 6699 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790740408.142972:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8f0dbd03c380 00000100:00100000:3.0:1790740408.143003:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 0 00000100:00100000:3.0:1790740408.143023:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd03c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ec599375-3198-45fd-a23a-c5620f07177c+8:2369:x1877727133071232:12345-192.168.203.58@tcp:4:lfs.0 00000001:00100000:1.0:1790740408.185442:0:6725:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ec599375-3198-45fd-a23a-c5620f07177c 00000100:00100000:3.0:1790740408.186251:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd03c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ec599375-3198-45fd-a23a-c5620f07177c+9:2369:x1877727133071232:12345-192.168.203.58@tcp:4:lfs.0 Request processed in 43232us (43470us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1790740408.186264:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 0 00002000:00100000:3.0:1790740408.186278:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff8f0dbd03c380 x1877727133071232/t4294967299(0) o4->ec599375-3198-45fd-a23a-c5620f07177c@192.168.203.58@tcp:464/0 lens 504/448 e 0 to 0 dl 1790740419 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790740408.186303:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f0dbd03c380 with x1877727133071232 ext(0->12) 00010000:00010000:3.0:1790740408.186314:0:6705:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000ba19b8fc/0xc6b31a1b598e9f51 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee462 expref: 9 pid: 6699 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740408.186333:0:6705:0:(ldlm_lockd.c:610:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000ba19b8fc/0xc6b31a1b598e9f51 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee462 expref: 9 pid: 6699 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790740408.186341:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8f0dbd03c380 00000100:00100000:1.0:1790740408.189330:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740408.189406:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133071360 00000100:00100000:2.0:1790740408.189415:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133071360 00010000:00010000:2.0:1790740408.189452:0:5830:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ba19b8fc/0xc6b31a1b598e9f51 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee462 expref: 9 pid: 6699 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740408.189497:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 36 00000100:00100000:2.0:1790740408.189506:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd03d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec599375-3198-45fd-a23a-c5620f07177c+9:2370:x1877727133071360:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790740408.189520:0:5830:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1790740408.189537:0:5830:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1790740408.189540:0:5830:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1790740407 00002000:00010000:2.0:1790740408.189542:0:5830:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1790740408 00002000:00010000:2.0:1790740408.189545:0:5830:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1790740407 00010000:00010000:2.0:1790740408.189551:0:5830:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ba19b8fc/0xc6b31a1b598e9f51 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee462 expref: 9 pid: 6699 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.189563:0:5830:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ba19b8fc/0xc6b31a1b598e9f51 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee462 expref: 9 pid: 6699 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.189742:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba19b8fc/0xc6b31a1b598e9f51 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee462 expref: 9 pid: 6699 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.189811:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790740408.189827:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790740408.189834:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000034db2d06/0xc6b31a1b598e9f9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.189844:0:5830:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034db2d06/0xc6b31a1b598e9f9e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.189909:0:5830:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790740408.189958:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd03d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec599375-3198-45fd-a23a-c5620f07177c+8:2370:x1877727133071360:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 452us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740408.189965:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 36 00010000:00010000:0.0:1790740408.191331:0:6700:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000034db2d06/0xc6b31a1b598e9f9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740408.191346:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034db2d06/0xc6b31a1b598e9f9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740408.191377:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034db2d06/0xc6b31a1b598e9f9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740408.191385:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034db2d06/0xc6b31a1b598e9f9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740408.191392:0:6700:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034db2d06/0xc6b31a1b598e9f9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740408.191399:0:6700:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9fea6800 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:0.0:1790740408.191403:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034db2d06/0xc6b31a1b598e9f9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740408.191411:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034db2d06/0xc6b31a1b598e9f9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740408.191430:0:6700:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034db2d06/0xc6b31a1b598e9f9e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740408.191452:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034db2d06/0xc6b31a1b598e9f9e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740408.191605:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd03f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec599375-3198-45fd-a23a-c5620f07177c+7:2369:x1877727133071104:12345-192.168.203.58@tcp:1:lfs.0 Request processed in 53269us (53452us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740408.191615:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 23 00000100:00100000:1.0:1790740408.195095:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740408.195174:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133071616 00000100:00100000:2.0:1790740408.195184:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133071616 00000100:00100000:2.0:1790740408.195244:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 8 00000100:00100000:2.0:1790740408.195253:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd03d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+20:10306:x1877727133071616:12345-192.168.203.58@tcp:35:lfs.0 00000004:00010000:2.0:1790740408.195315:0:5846:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598e9f90 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee47e expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790740408.195611:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1790740408.195678:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1790740408.196843:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1790740408.196910:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6a00/0xc6b31a1b598e9fa5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740408.196929:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598e9f35 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee454 expref: 24 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740408.196939:0:5846:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6a00/0xc6b31a1b598e9fa5 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740408.196974:0:5846:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598e9f35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee454 expref: 24 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740408.196990:0:5846:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598e9f35 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee454 expref: 24 pid: 5843 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740408.197005:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1290380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5846:1877727158270848:192.168.203.58@tcp:104: 00000100:00100000:0.0:1790740408.197095:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d87584180 going to sleep for 11 seconds 00000100:00100000:0.0:1790740408.200055:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1290380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5846:1877727158270848:192.168.203.58@tcp:104: 00010000:00010000:0.0:1790740408.200082:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6a00/0xc6b31a1b598e9fa5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740408.201401:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740408.201692:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133071744 00000100:00100000:3.0:1790740408.201702:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133071744 00010000:00010000:3.0:1790740408.201741:0:5828:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598e9f35 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee454 expref: 25 pid: 5843 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740408.201790:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 37 00000100:00100000:3.0:1790740408.201801:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8498fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec599375-3198-45fd-a23a-c5620f07177c+25:2369:x1877727133071744:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790740408.201816:0:5828:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740408.201823:0:5828:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598e9f35 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee454 expref: 25 pid: 5843 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740408.201835:0:5828:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598e9f35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee454 expref: 25 pid: 5843 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740408.201856:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598e9f35 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee454 expref: 25 pid: 5843 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740408.201872:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f0d98dcc900) 00010000:00010000:3.0:1790740408.201887:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6a00/0xc6b31a1b598e9fa5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740408.201897:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6a00/0xc6b31a1b598e9fa5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740408.201905:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6a00/0xc6b31a1b598e9fa5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740408.201936:0:5828:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790740408.201993:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8498fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec599375-3198-45fd-a23a-c5620f07177c+24:2369:x1877727133071744:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 194us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740408.202000:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 37 00010000:00010000:0.0:1790740408.202124:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6a00/0xc6b31a1b598e9fa5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740408.202132:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6a00/0xc6b31a1b598e9fa5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790740408.202258:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1790740408.202453:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:0.0:1790740408.202634:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1290380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1877727158270976:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790740408.202693:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740408.202715:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d87584f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790740408.202989:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158270976 00000100:00100000:2.0:1790740408.202997:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158270976 00000100:00100000:2.0:1790740408.203050:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790740408.203059:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1290e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1877727158270976:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1790740408.203142:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1290e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1877727158270976:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 84us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740408.203149:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790740408.203198:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1290380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1877727158270976:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1790740408.204436:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1790740408.204512:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1b6df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1877727158271104:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1790740408.204555:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740408.204609:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d8956f540 going to sleep for 11 seconds 00000100:00100000:0.0:1790740408.204707:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158271104 00000100:00100000:0.0:1790740408.204715:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158271104 00000100:00100000:0.0:1790740408.204744:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790740408.204752:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1b6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1877727158271104:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790740408.204920:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1b6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5846:x1877727158271104:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 168us (363us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1790740408.204928:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1790740408.205155:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790740408.205541:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1b6df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1877727158271104:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1790740408.206128:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:2.0:1790740408.206170:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6a00/0xc6b31a1b598e9fa5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.206182:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6a00/0xc6b31a1b598e9fa5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.206191:0:5846:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6a00/0xc6b31a1b598e9fa5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.206198:0:5846:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9fea6a00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740408.206203:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6a00/0xc6b31a1b598e9fa5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.206211:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6a00/0xc6b31a1b598e9fa5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.206226:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f0d98dcc900) 00010000:00010000:2.0:1790740408.206241:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1790740408.206246:0:5846:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6a00/0xc6b31a1b598e9fa5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.206252:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6a00/0xc6b31a1b598e9fa5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790740408.206439:0:5846:0:(mdd_object.c:4180:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1790740408.206912:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1790740408.206923:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 324157350434ns, next at 325157348049ns, rc = 0 00000001:00080000:2.0:1790740408.206931:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1790740408.206969:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f0d98dcc900) 00010000:00010000:2.0:1790740408.206972:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1790740408.206980:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598e9f90 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee47e expref: 28 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740408.207158:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd03d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+27:10306:x1877727133071616:12345-192.168.203.58@tcp:35:lfs.0 Request processed in 11904us (12068us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1790740408.207168:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 8 00000020:00080000:2.0:1790740408.207173:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1790740408.210124:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740408.210195:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133071872 00000100:00100000:2.0:1790740408.210204:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133071872 00000100:00100000:2.0:1790740408.210266:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 45 00000100:00100000:2.0:1790740408.210275:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8498d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+27:10306:x1877727133071872:12345-192.168.203.58@tcp:101:lfs.0 00010000:00010000:2.0:1790740408.210297:0:8666:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740408.210319:0:8666:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598e9fac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee485 expref: -99 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.210398:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598e9fac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee485 expref: 28 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.210413:0:8666:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598e9fac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee485 expref: 28 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.210448:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f0d98dcc200) 00010000:00010000:2.0:1790740408.210451:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790740408.210454:0:8666:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d87594400, rc 0) 00000100:00100000:2.0:1790740408.210510:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8498d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+28:10306:x1877727133071872:12345-192.168.203.58@tcp:101:lfs.0 Request processed in 234us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740408.210517:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 45 00000100:00100000:1.0:1790740408.213473:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740408.213554:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133072128 00000100:00100000:3.0:1790740408.213564:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133072128 00000100:00100000:3.0:1790740408.213661:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 9 00000100:00100000:3.0:1790740408.213672:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0da2038c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec599375-3198-45fd-a23a-c5620f07177c+28:10306:x1877727133072128:12345-192.168.203.58@tcp:35:lfs.0 00000100:00100000:3.0:1790740408.214107:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0da2038c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec599375-3198-45fd-a23a-c5620f07177c+29:10306:x1877727133072128:12345-192.168.203.58@tcp:35:lfs.0 Request processed in 436us (640us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1790740408.214116:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 9 00000100:00100000:1.0:1790740408.320154:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740408.320255:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133072384 00000100:00100000:2.0:1790740408.320267:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133072384 00000100:00100000:2.0:1790740408.320332:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 46 00000100:00100000:2.0:1790740408.320344:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8498d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+29:10316:x1877727133072384:12345-192.168.203.58@tcp:101:lfs.0 00010000:00010000:2.0:1790740408.320371:0:5843:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740408.320394:0:5843:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598e9fb3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee48c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740408.320512:0:5843:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1790740408.320685:0:5843:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598e9fb3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee48c expref: 31 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.320699:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0d944f6d00) 00010000:00010000:2.0:1790740408.320702:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790740408.320706:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598e9fb3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee48c expref: 31 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.320719:0:5843:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d87594800, rc 0) 00000100:00100000:2.0:1790740408.320780:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8498d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+30:10316:x1877727133072384:12345-192.168.203.58@tcp:101:lfs.0 Request processed in 439us (635us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1790740408.320796:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 46 00000100:00100000:1.0:1790740408.325059:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740408.325202:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133072512 00000100:00100000:2.0:1790740408.325212:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133072512 00000100:00100000:2.0:1790740408.325279:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 47 00000100:00100000:2.0:1790740408.325289:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8498c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+30:10316:x1877727133072512:12345-192.168.203.58@tcp:34:lfs.0 00010000:00010000:2.0:1790740408.325367:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598e9fc1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.325386:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598e9fc1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.325398:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598e9fc1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.325415:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595600/0xc6b31a1b598e9fc8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.325422:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595600/0xc6b31a1b598e9fc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.325428:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595600/0xc6b31a1b598e9fc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.325515:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598e9fcf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.325523:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598e9fcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.325530:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598e9fcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790740408.325614:0:8666:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598e9fcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.325627:0:8666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598e9fc1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.325633:0:8666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598e9fc1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.325640:0:8666:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598e9fc1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.325647:0:8666:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87594200 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740408.325651:0:8666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598e9fc1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.325658:0:8666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598e9fc1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.325669:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f0d98dccb00) 00010000:00010000:2.0:1790740408.325672:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740408.325677:0:8666:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598e9fc1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.325683:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598e9fc1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.325695:0:8666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595600/0xc6b31a1b598e9fc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.325700:0:8666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595600/0xc6b31a1b598e9fc8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.325711:0:8666:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595600/0xc6b31a1b598e9fc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.325716:0:8666:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87595600 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740408.325718:0:8666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595600/0xc6b31a1b598e9fc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.325724:0:8666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595600/0xc6b31a1b598e9fc8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.325731:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8f0d98dcc900) 00010000:00010000:2.0:1790740408.325733:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740408.325736:0:8666:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595600/0xc6b31a1b598e9fc8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.325740:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595600/0xc6b31a1b598e9fc8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.325755:0:8666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598e9fcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.325893:0:8666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598e9fcf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.325898:0:8666:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598e9fcf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.325903:0:8666:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87595e00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740408.325906:0:8666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598e9fcf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.325923:0:8666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598e9fcf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.325931:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f0d98dcc200) 00010000:00010000:2.0:1790740408.325934:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740408.325937:0:8666:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598e9fcf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.325942:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598e9fcf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740408.326025:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8498c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+30:10316:x1877727133072512:12345-192.168.203.58@tcp:34:lfs.0 Request processed in 736us (974us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740408.326034:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 47 00000100:00100000:1.0:1790740408.329062:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740408.329139:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133072768 00000100:00100000:2.0:1790740408.329151:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133072768 00000100:00100000:2.0:1790740408.329208:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 10 00000100:00100000:2.0:1790740408.329219:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8498f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+30:10316:x1877727133072768:12345-192.168.203.58@tcp:35:lfs.0 00000100:00100000:2.0:1790740408.329455:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8498f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+31:10316:x1877727133072768:12345-192.168.203.58@tcp:35:lfs.0 Request processed in 237us (401us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1790740408.329463:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 10 00000100:00100000:1.0:1790740408.370628:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740408.371031:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133073024 00000100:00100000:2.0:1790740408.371044:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133073024 00000100:00100000:2.0:1790740408.371122:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 48 00000100:00100000:2.0:1790740408.371132:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8498dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+31:10319:x1877727133073024:12345-192.168.203.58@tcp:101:lfs.0 00010000:00010000:2.0:1790740408.371157:0:5843:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740408.371177:0:5843:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598e9fd6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee493 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.371281:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595600/0xc6b31a1b598e9fdd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.371296:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595600/0xc6b31a1b598e9fdd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.371306:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595600/0xc6b31a1b598e9fdd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.371318:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598e9fe4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.371325:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598e9fe4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.371332:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598e9fe4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.371669:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598e9feb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.371678:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598e9feb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.371685:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598e9feb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740408.371695:0:5843:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1790740408.371855:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595600/0xc6b31a1b598e9fdd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.371863:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595600/0xc6b31a1b598e9fdd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.371880:0:5843:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595600/0xc6b31a1b598e9fdd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.371886:0:5843:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87595600 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740408.371889:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595600/0xc6b31a1b598e9fdd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.371896:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595600/0xc6b31a1b598e9fdd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.371908:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f0d98dccb00) 00010000:00010000:2.0:1790740408.371911:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740408.371915:0:5843:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595600/0xc6b31a1b598e9fdd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.371921:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595600/0xc6b31a1b598e9fdd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.371934:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598e9fe4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.371939:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598e9fe4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.371944:0:5843:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598e9fe4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.371949:0:5843:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87594200 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740408.371951:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598e9fe4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.371966:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598e9fe4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.371974:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8f0d98dcc900) 00010000:00010000:2.0:1790740408.371976:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740408.371978:0:5843:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598e9fe4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.371984:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598e9fe4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.372025:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598e9fd6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee493 expref: 34 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.372038:0:5843:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598e9feb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee493 expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.372044:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f0d98dcc200) 00010000:00010000:2.0:1790740408.372046:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790740408.372048:0:5843:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d87594800, rc 0) 00000100:00100000:2.0:1790740408.372286:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8498dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+33:10319:x1877727133073024:12345-192.168.203.58@tcp:101:lfs.0 Request processed in 1154us (1665us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1790740408.372294:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 48 00000100:00100000:1.0:1790740408.379391:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740408.379643:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133073152 00000100:00100000:0.0:1790740408.379715:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133073152 00000100:00100000:0.0:1790740408.379856:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 49 00000100:00100000:0.0:1790740408.379868:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc0963800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+33:10319:x1877727133073152:12345-192.168.203.58@tcp:54:lfs.0 00010000:00010000:0.0:1790740408.379936:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6800/0xc6b31a1b598e9ff9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740408.379954:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6800/0xc6b31a1b598e9ff9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740408.379983:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6800/0xc6b31a1b598e9ff9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740408.380010:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6800/0xc6b31a1b598e9ff9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740408.380018:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6800/0xc6b31a1b598e9ff9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740408.380024:0:5844:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6800/0xc6b31a1b598e9ff9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740408.380030:0:5844:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9fea6800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1790740408.380034:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6800/0xc6b31a1b598e9ff9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740408.380041:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6800/0xc6b31a1b598e9ff9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740408.380054:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f0d98dcc200) 00010000:00010000:0.0:1790740408.380058:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790740408.380062:0:5844:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6800/0xc6b31a1b598e9ff9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740408.380069:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6800/0xc6b31a1b598e9ff9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740408.380158:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc0963800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+33:10319:x1877727133073152:12345-192.168.203.58@tcp:54:lfs.0 Request processed in 292us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740408.380166:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 49 00000100:00100000:1.0:1790740408.382933:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740408.383019:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133073408 00000100:00100000:2.0:1790740408.383029:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133073408 00000100:00100000:2.0:1790740408.383121:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 11 00000100:00100000:2.0:1790740408.383132:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc0962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+33:10319:x1877727133073408:12345-192.168.203.58@tcp:35:lfs.0 00000100:00100000:2.0:1790740408.383400:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc0962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+34:10319:x1877727133073408:12345-192.168.203.58@tcp:35:lfs.0 Request processed in 266us (471us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1790740408.383408:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 11 00010000:00010000:1.0:1790740408.624763:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740408.690996:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740408.691359:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133073664 00000100:00100000:0.0:1790740408.691376:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133073664 00000100:00100000:0.0:1790740408.691435:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 50 00000100:00100000:0.0:1790740408.691446:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc0963b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+34:10350:x1877727133073664:12345-192.168.203.58@tcp:101:cat.0 00010000:00010000:0.0:1790740408.691471:0:5842:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740408.691493:0:5842:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6800/0xc6b31a1b598ea000 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee49a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740408.691943:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6a00/0xc6b31a1b598ea007 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740408.691960:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6a00/0xc6b31a1b598ea007 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740408.691974:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6a00/0xc6b31a1b598ea007 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790740408.691985:0:5842:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1790740408.692668:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6800/0xc6b31a1b598ea000 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee49a expref: 37 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740408.692691:0:5842:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6a00/0xc6b31a1b598ea007 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee49a expref: 36 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740408.692700:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f0d98dcc200) 00010000:00010000:0.0:1790740408.692703:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790740408.692707:0:5842:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9fea6a00, rc 0) 00000100:00100000:0.0:1790740408.692781:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc0963b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+36:10350:x1877727133073664:12345-192.168.203.58@tcp:101:cat.0 Request processed in 1335us (1795us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1790740408.692791:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 50 00000100:00100000:2.0:1790740408.701707:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740408.701769:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740408.701808:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133074048 00000100:00100000:2.0:1790740408.701817:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133074048 00000100:00100000:2.0:1790740408.701873:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 3 00000100:00100000:2.0:1790740408.701883:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d87402050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec599375-3198-45fd-a23a-c5620f07177c+36:2371:x1877727133074048:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790740408.701898:0:5830:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740408.701922:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6a00/0xc6b31a1b598ea007 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee49a expref: 36 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.701941:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f0d98dcc200) 00010000:00010000:2.0:1790740408.701946:0:5830:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790740408.701997:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d87402050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec599375-3198-45fd-a23a-c5620f07177c+35:2371:x1877727133074048:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 115us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740408.702005:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 3 00000100:00100000:3.0:1790740408.708069:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133073920 00000100:00100000:3.0:1790740408.708083:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133073920 00000100:00100000:3.0:1790740408.708142:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 12 00000100:00100000:3.0:1790740408.708153:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1b6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec599375-3198-45fd-a23a-c5620f07177c+35:10350:x1877727133073920:12345-192.168.203.58@tcp:35:cat.0 00000100:00100000:3.0:1790740408.709410:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1b6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec599375-3198-45fd-a23a-c5620f07177c+36:10350:x1877727133073920:12345-192.168.203.58@tcp:35:cat.0 Request processed in 1253us (7706us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1790740408.709421:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 12 00000001:00080000:0.0:1790740408.719985:0:5865:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967322 is committed 00000001:00080000:0.0:1790740408.720333:0:5865:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967330 is committed 00000004:00080000:0.0:1790740408.720347:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:0.0:1790740408.720367:0:5865:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f0d8956f600 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1790740408.720371:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f0db578fb00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f0d8956f300 00000020:00080000:0.0:1790740408.720375:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f0db578f000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f0dbee0f000 00000020:00080000:3.0:1790740408.720541:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000100:00100000:1.0:1790740408.720652:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790740408.720673:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1b6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158271232:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1790740408.720741:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1790740408.721428:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1790740408.721870:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158271232 00000100:00100000:2.0:1790740408.721879:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158271232 00000100:00100000:2.0:1790740408.721936:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790740408.721946:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc0962680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1877727158271232:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1790740408.721979:0:6701:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1790740408.722491:0:6701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6abc87b7, atime: 0x6abc87b8, ctime: 0x6abc87b7, blocks: 0x1 00010000:00010000:2.0:1790740408.722501:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f01ebd8/0xc6b31a1b598ea015 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.722534:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=324s v=(0 0) 00010000:00010000:2.0:1790740408.722538:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790740408.722545:0:6701:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f01ebd8/0xc6b31a1b598ea015 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.722559:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f01ebd8/0xc6b31a1b598ea015 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.722593:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f01ebd8/0xc6b31a1b598ea015 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.722603:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000f01ebd8/0xc6b31a1b598ea015 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.722629:0:6701:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790740408.722902:0:11661:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790740408.722909:0:11661:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000f01ebd8/0xc6b31a1b598ea015 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740408.722917:0:11661:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87595e00 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:1.0:1790740408.722921:0:11661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000f01ebd8/0xc6b31a1b598ea015 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740408.722930:0:11661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000f01ebd8/0xc6b31a1b598ea015 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740408.722950:0:11661:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000f01ebd8/0xc6b31a1b598ea015 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740408.722967:0:11661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f01ebd8/0xc6b31a1b598ea015 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740408.722988:0:11661:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740408.722990:0:11661:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740408.722992:0:11661:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740408.723566:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc0962680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3304:x1877727158271232:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1618us (2821us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1790740408.723598:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:1.0:1790740408.723789:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f0dc1b6d500/2, rc 0, transno 4294967301 00000100:00100000:1.0:1790740408.723796:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1b6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158271232:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1790740408.813282:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740408.816518:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133074304 00000100:00100000:3.0:1790740408.816534:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133074304 00000100:00100000:3.0:1790740408.816615:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 51 00000100:00100000:3.0:1790740408.816625:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1b6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+14:10356:x1877727133074304:12345-192.168.203.58@tcp:101:dd.0 00010000:00010000:3.0:1790740408.816649:0:8666:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740408.816652:0:8666:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1790740408.816678:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594600/0xc6b31a1b598e9f6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee470 expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740408.816696:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f0d98dccb00) 00010000:00010000:3.0:1790740408.816701:0:8666:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790740408.816714:0:8666:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fa00/0xc6b31a1b598ea01c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee4a1 expref: -99 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740408.816804:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea023 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740408.816818:0:8666:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598e9feb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee493 expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740408.816826:0:8666:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea023 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740408.816859:0:8666:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598e9feb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee493 expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740408.816874:0:8666:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598e9feb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee493 expref: 14 pid: 5843 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740408.816902:0:8666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbee2c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8666:1877727158271360:192.168.203.58@tcp:104: 00000100:00100000:3.0:1790740408.818675:0:8666:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0db6f3b180 going to sleep for 11 seconds 00000100:00100000:1.0:1790740408.831652:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740408.831770:0:8666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbee2c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8666:1877727158271360:192.168.203.58@tcp:104: 00010000:00010000:3.0:1790740408.831798:0:8666:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea023 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740408.834238:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133074432 00000100:00100000:2.0:1790740408.834254:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133074432 00010000:00010000:2.0:1790740408.834311:0:5828:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598e9feb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee493 expref: 15 pid: 5843 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740408.838101:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 38 00000100:00100000:2.0:1790740408.838127:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1a43100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec599375-3198-45fd-a23a-c5620f07177c+15:2370:x1877727133074432:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790740408.838161:0:5828:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740408.838175:0:5828:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598e9feb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee493 expref: 15 pid: 5843 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.838192:0:5828:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598e9feb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee493 expref: 15 pid: 5843 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.838216:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598e9feb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee493 expref: 15 pid: 5843 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.838242:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f0d98dcc200) 00010000:00010000:2.0:1790740408.838247:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea023 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.838257:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea023 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.838264:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea023 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.838293:0:5828:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790740408.838358:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1a43100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec599375-3198-45fd-a23a-c5620f07177c+14:2370:x1877727133074432:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 244us (6714us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740408.838366:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 38 00010000:00010000:0.0:1790740408.838444:0:8666:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea023 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740408.838452:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea023 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790740408.838471:0:8666:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1790740408.838681:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fa00/0xc6b31a1b598ea01c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4a1 expref: 15 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740408.838698:0:8666:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea023 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4a1 expref: 14 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740408.838705:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f0d98dcc200) 00010000:00010000:0.0:1790740408.838708:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790740408.838711:0:8666:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0db6c0ee00, rc 0) 00000100:00100000:0.0:1790740408.838736:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1b6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+14:10356:x1877727133074304:12345-192.168.203.58@tcp:101:dd.0 Request processed in 22113us (25464us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1790740408.838743:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 51 00000100:00100000:1.0:1790740408.845865:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740408.845924:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133074688 00000100:00100000:2.0:1790740408.845933:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133074688 00000100:00100000:2.0:1790740408.846014:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 52 00000100:00100000:2.0:1790740408.846022:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1a42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+14:10356:x1877727133074688:12345-192.168.203.58@tcp:36:dd.0 00010000:00010000:2.0:1790740408.846300:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea031 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.846318:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea031 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.846337:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea031 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790740408.846394:0:5843:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1790740408.846420:0:5843:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000003e090c31 reply state 00000000e01b2a7e transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea031 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740408.846429:0:5843:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790740408.846524:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1a42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+17:10356:x1877727133074688:12345-192.168.203.58@tcp:36:dd.0 Request processed in 502us (668us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1790740408.846532:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 52 00000020:00080000:2.0:1790740408.846537:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790740408.848883:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea031 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.848900:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea031 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.848908:0:3289:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea031 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.848915:0:3289:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87594200 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740408.848920:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea031 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.848927:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea031 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.848957:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f0d98dcc200) 00010000:00010000:2.0:1790740408.848961:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740408.848966:0:3289:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea031 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740408.848972:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea031 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740409.206270:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740409.206429:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133074816 00000100:00100000:0.0:1790740409.206440:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133074816 00000100:00100000:0.0:1790740409.206516:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 53 00000100:00100000:0.0:1790740409.206527:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1a43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+16:10370:x1877727133074816:12345-192.168.203.58@tcp:101:stat.0 00010000:00010000:0.0:1790740409.206568:0:5844:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740409.206629:0:5844:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6800/0xc6b31a1b598ea038 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee4a8 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.206710:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6a00/0xc6b31a1b598ea03f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.206725:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6a00/0xc6b31a1b598ea03f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.206739:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6a00/0xc6b31a1b598ea03f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.206755:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc21d2a00/0xc6b31a1b598ea046 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.206761:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc21d2a00/0xc6b31a1b598ea046 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.206768:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc21d2a00/0xc6b31a1b598ea046 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.207064:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc21d3800/0xc6b31a1b598ea04d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.207077:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea023 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4a1 expref: 17 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.207085:0:5844:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc21d3800/0xc6b31a1b598ea04d lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.207121:0:5844:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea023 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4a1 expref: 17 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.207141:0:5844:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea023 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4a1 expref: 17 pid: 8666 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740409.207156:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1291880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1877727158271488:192.168.203.58@tcp:104: 00000100:00080000:3.0:1790740409.207192:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790740409.207261:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0dbd398240 going to sleep for 11 seconds 00000100:00100000:1.0:1790740409.218119:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740409.218139:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1291880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1877727158271488:192.168.203.58@tcp:104: 00010000:00010000:0.0:1790740409.218169:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc21d3800/0xc6b31a1b598ea04d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740409.222825:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133075072 00000100:00100000:2.0:1790740409.222841:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133075072 00000100:00100000:2.0:1790740409.223674:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 13 00000100:00100000:2.0:1790740409.223688:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1a40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+18:5608:x1877727133075072:12345-192.168.203.58@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1790740409.224841:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1a40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+19:5608:x1877727133075072:12345-192.168.203.58@tcp:35:ldlm_bl.0 Request processed in 1153us (6728us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1790740409.224851:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 13 00000100:00100000:2.0:1790740409.229522:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740409.230419:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133075200 00000100:00100000:0.0:1790740409.230431:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133075200 00010000:00010000:0.0:1790740409.230475:0:5830:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea023 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4a1 expref: 19 pid: 8666 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740409.230518:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 39 00000100:00100000:0.0:1790740409.230527:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1b6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec599375-3198-45fd-a23a-c5620f07177c+19:2370:x1877727133075200:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790740409.230541:0:5830:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740409.230548:0:5830:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea023 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4a1 expref: 19 pid: 8666 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.230560:0:5830:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea023 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4a1 expref: 19 pid: 8666 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.230614:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea023 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4a1 expref: 19 pid: 8666 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.230648:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f0d98dcc200) 00010000:00010000:0.0:1790740409.230653:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc21d3800/0xc6b31a1b598ea04d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.230663:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc21d3800/0xc6b31a1b598ea04d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.230679:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc21d3800/0xc6b31a1b598ea04d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.230704:0:5830:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740409.231386:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1b6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec599375-3198-45fd-a23a-c5620f07177c+18:2370:x1877727133075200:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 856us (1870us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740409.231396:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 39 00010000:00010000:1.0:1790740409.231604:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc21d3800/0xc6b31a1b598ea04d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740409.231615:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc21d3800/0xc6b31a1b598ea04d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790740409.231661:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1790740409.231665:0:5844:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790740409.231714:0:5844:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc21d3800/0xc6b31a1b598ea04d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740409.231725:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc21d3800/0xc6b31a1b598ea04d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740409.231735:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6a00/0xc6b31a1b598ea03f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740409.231754:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6a00/0xc6b31a1b598ea03f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740409.231760:0:5844:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6a00/0xc6b31a1b598ea03f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740409.231766:0:5844:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9fea6a00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1790740409.231771:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6a00/0xc6b31a1b598ea03f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740409.231778:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6a00/0xc6b31a1b598ea03f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740409.231788:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f0d98dccb00) 00010000:00010000:1.0:1790740409.231791:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740409.231794:0:5844:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6a00/0xc6b31a1b598ea03f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740409.231800:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6a00/0xc6b31a1b598ea03f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740409.231811:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc21d2a00/0xc6b31a1b598ea046 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740409.231817:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc21d2a00/0xc6b31a1b598ea046 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740409.231823:0:5844:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc21d2a00/0xc6b31a1b598ea046 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740409.231828:0:5844:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc21d2a00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1790740409.231834:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc21d2a00/0xc6b31a1b598ea046 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740409.231841:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc21d2a00/0xc6b31a1b598ea046 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740409.231848:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8f0d82841d00) 00010000:00010000:1.0:1790740409.231850:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740409.231852:0:5844:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc21d2a00/0xc6b31a1b598ea046 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740409.231867:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc21d2a00/0xc6b31a1b598ea046 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740409.231902:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6800/0xc6b31a1b598ea038 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4a8 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740409.231914:0:5844:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc21d3800/0xc6b31a1b598ea04d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4a8 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740409.231920:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f0d98dcc200) 00010000:00010000:1.0:1790740409.231922:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790740409.231932:0:5844:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0dc21d3800, rc 0) 00000100:00100000:1.0:1790740409.231970:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1a43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+17:10370:x1877727133074816:12345-192.168.203.58@tcp:101:stat.0 Request processed in 25446us (25710us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740409.231978:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 53 00000100:00100000:1.0:1790740409.340508:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740409.340608:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133075456 00000100:00100000:0.0:1790740409.340619:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133075456 00000100:00100000:0.0:1790740409.340747:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 54 00000100:00100000:0.0:1790740409.340758:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1a42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+17:10376:x1877727133075456:12345-192.168.203.58@tcp:36:truncate.0 00010000:00010000:0.0:1790740409.340814:0:5842:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740409.340841:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc21d3800/0xc6b31a1b598ea04d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4a8 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.340860:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f0d98dcc200) 00010000:00010000:0.0:1790740409.340866:0:5842:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790740409.341080:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc21d2a00/0xc6b31a1b598ea054 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.341093:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc21d2a00/0xc6b31a1b598ea054 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.341121:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc21d2a00/0xc6b31a1b598ea054 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790740409.341172:0:5842:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:0.0:1790740409.341196:0:5842:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000009e29a362 reply state 0000000003579af4 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc21d2a00/0xc6b31a1b598ea054 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740409.341203:0:5842:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790740409.341324:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1a42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+19:10376:x1877727133075456:12345-192.168.203.58@tcp:36:truncate.0 Request processed in 567us (824us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1790740409.341332:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 54 00000020:00080000:0.0:1790740409.341337:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790740409.344155:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc21d2a00/0xc6b31a1b598ea054 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740409.344173:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc21d2a00/0xc6b31a1b598ea054 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740409.344181:0:3290:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc21d2a00/0xc6b31a1b598ea054 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740409.344188:0:3290:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc21d2a00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1790740409.344193:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc21d2a00/0xc6b31a1b598ea054 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740409.344201:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc21d2a00/0xc6b31a1b598ea054 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740409.344217:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f0d98dcc200) 00010000:00010000:3.0:1790740409.344220:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740409.344234:0:3290:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc21d2a00/0xc6b31a1b598ea054 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740409.344241:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc21d2a00/0xc6b31a1b598ea054 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740409.537848:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740409.537991:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133075584 00000100:00100000:0.0:1790740409.538002:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133075584 00000100:00100000:0.0:1790740409.538062:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 55 00000100:00100000:0.0:1790740409.538072:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1a40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+18:10390:x1877727133075584:12345-192.168.203.58@tcp:101:stat.0 00010000:00010000:0.0:1790740409.538094:0:8666:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740409.538116:0:8666:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc21d3800/0xc6b31a1b598ea05b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee4af expref: -99 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.538191:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc21d2a00/0xc6b31a1b598ea062 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.538206:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc21d2a00/0xc6b31a1b598ea062 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.538217:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc21d2a00/0xc6b31a1b598ea062 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.538276:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea069 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.538285:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea069 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.538291:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea069 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.538564:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e200/0xc6b31a1b598ea070 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.538617:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e200/0xc6b31a1b598ea070 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.538625:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e200/0xc6b31a1b598ea070 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790740409.538661:0:8666:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1790740409.538666:0:8666:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790740409.538686:0:8666:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e200/0xc6b31a1b598ea070 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.538697:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e200/0xc6b31a1b598ea070 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.538704:0:8666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc21d2a00/0xc6b31a1b598ea062 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.538711:0:8666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc21d2a00/0xc6b31a1b598ea062 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.538728:0:8666:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc21d2a00/0xc6b31a1b598ea062 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.538734:0:8666:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc21d2a00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1790740409.538739:0:8666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc21d2a00/0xc6b31a1b598ea062 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.538890:0:8666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc21d2a00/0xc6b31a1b598ea062 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.538905:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f0d98dccb00) 00010000:00010000:0.0:1790740409.538908:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740409.538914:0:8666:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc21d2a00/0xc6b31a1b598ea062 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.538921:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc21d2a00/0xc6b31a1b598ea062 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.538935:0:8666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea069 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.538942:0:8666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea069 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.538948:0:8666:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea069 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.538952:0:8666:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132f800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1790740409.538955:0:8666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea069 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.538972:0:8666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea069 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.538980:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8f0d82841600) 00010000:00010000:0.0:1790740409.538982:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740409.538985:0:8666:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea069 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.538992:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea069 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.539024:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc21d3800/0xc6b31a1b598ea05b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4af expref: 20 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.539038:0:8666:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e200/0xc6b31a1b598ea070 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4af expref: 19 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.539045:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f0d98dcc200) 00010000:00010000:0.0:1790740409.539047:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790740409.539049:0:8666:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0dc132e200, rc 0) 00000100:00100000:0.0:1790740409.539120:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1a40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+19:10390:x1877727133075584:12345-192.168.203.58@tcp:101:stat.0 Request processed in 1049us (1280us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740409.539128:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 55 00000100:00100000:2.0:1790740409.645158:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740409.645363:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133075840 00000100:00100000:1.0:1790740409.645377:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133075840 00000100:00100000:1.0:1790740409.645477:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 56 00000100:00100000:1.0:1790740409.645488:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1b6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+19:10400:x1877727133075840:12345-192.168.203.58@tcp:101:lfs.0 00010000:00010000:1.0:1790740409.645518:0:5843:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740409.645547:0:5843:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea077 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee4b6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790740409.645722:0:5843:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1790740409.645890:0:5843:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea077 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4b6 expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740409.645906:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0d944f6d00) 00010000:00010000:1.0:1790740409.645909:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790740409.645915:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea077 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4b6 expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740409.645938:0:5843:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9f976000, rc 0) 00000100:00100000:1.0:1790740409.646029:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1b6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+20:10400:x1877727133075840:12345-192.168.203.58@tcp:101:lfs.0 Request processed in 542us (886us total) trans 4294967339 rc 301/301 00000100:00100000:1.0:1790740409.646037:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 56 00010000:00010000:2.0:1790740409.650177:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740409.656782:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740409.659355:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133076096 00000100:00100000:0.0:1790740409.659378:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133076096 00000100:00100000:0.0:1790740409.659480:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 14 00000100:00100000:0.0:1790740409.659494:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1b6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec599375-3198-45fd-a23a-c5620f07177c+20:10400:x1877727133076096:12345-192.168.203.58@tcp:35:lfs.0 00000100:00100000:0.0:1790740409.659899:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1b6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec599375-3198-45fd-a23a-c5620f07177c+21:10400:x1877727133076096:12345-192.168.203.58@tcp:35:lfs.0 Request processed in 408us (3131us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1790740409.659909:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 14 00000100:00100000:2.0:1790740409.727014:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740409.727186:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133076352 00000100:00100000:0.0:1790740409.727200:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133076352 00000100:00100000:0.0:1790740409.727293:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 57 00000100:00100000:0.0:1790740409.727305:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1b6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+21:10406:x1877727133076352:12345-192.168.203.58@tcp:101:bash.0 00010000:00010000:0.0:1790740409.727338:0:8666:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740409.727366:0:8666:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea085 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee4bd expref: -99 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.727495:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f000/0xc6b31a1b598ea08c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.727513:0:8666:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e200/0xc6b31a1b598ea070 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4af expref: 22 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.727524:0:8666:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f000/0xc6b31a1b598ea08c lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.727568:0:8666:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e200/0xc6b31a1b598ea070 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4af expref: 22 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.727621:0:8666:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e200/0xc6b31a1b598ea070 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4af expref: 22 pid: 8666 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740409.727637:0:8666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1291880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8666:1877727158271616:192.168.203.58@tcp:104: 00000100:00100000:0.0:1790740409.728007:0:8666:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0dbd398900 going to sleep for 11 seconds 00000100:00100000:2.0:1790740409.731358:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740409.731490:0:8666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1291880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8666:1877727158271616:192.168.203.58@tcp:104: 00010000:00010000:0.0:1790740409.731529:0:8666:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f000/0xc6b31a1b598ea08c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740409.732362:0:8506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133076480 00000100:00100000:3.0:1790740409.732374:0:8506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133076480 00010000:00010000:3.0:1790740409.732427:0:8506:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e200/0xc6b31a1b598ea070 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4af expref: 23 pid: 8666 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740409.732521:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 40 00000100:00100000:3.0:1790740409.732532:0:8506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1b6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec599375-3198-45fd-a23a-c5620f07177c+23:2369:x1877727133076480:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790740409.732550:0:8506:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740409.732557:0:8506:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e200/0xc6b31a1b598ea070 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4af expref: 23 pid: 8666 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740409.732586:0:8506:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e200/0xc6b31a1b598ea070 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4af expref: 23 pid: 8666 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740409.732611:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e200/0xc6b31a1b598ea070 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4af expref: 23 pid: 8666 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740409.732630:0:8506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f0d98dcc200) 00010000:00010000:3.0:1790740409.732635:0:8506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f000/0xc6b31a1b598ea08c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740409.732657:0:8506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f000/0xc6b31a1b598ea08c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740409.732666:0:8506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f000/0xc6b31a1b598ea08c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740409.732697:0:8506:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790740409.735365:0:8666:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f000/0xc6b31a1b598ea08c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.735390:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f000/0xc6b31a1b598ea08c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790740409.735423:0:8666:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1790740409.735690:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea085 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4bd expref: 24 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.735716:0:8666:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f000/0xc6b31a1b598ea08c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4bd expref: 23 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.735726:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f0d98dcc200) 00010000:00010000:0.0:1790740409.735729:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790740409.735734:0:8666:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0dc132f000, rc 0) 00000100:00100000:3.0:1790740409.735943:0:8506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1b6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec599375-3198-45fd-a23a-c5620f07177c+23:2369:x1877727133076480:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 3409us (4596us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740409.735956:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 40 00000100:00100000:0.0:1790740409.737244:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1b6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+22:10406:x1877727133076352:12345-192.168.203.58@tcp:101:bash.0 Request processed in 9918us (10221us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1790740409.737257:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 57 00000100:00100000:2.0:1790740409.747020:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740409.747147:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133076736 00000100:00100000:1.0:1790740409.747160:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133076736 00000100:00100000:1.0:1790740409.747274:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 58 00000100:00100000:1.0:1790740409.748404:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1b6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+22:10406:x1877727133076736:12345-192.168.203.58@tcp:36:bash.0 00010000:00010000:1.0:1790740409.748778:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea09a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740409.748804:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea09a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740409.748834:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea09a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790740409.748895:0:5843:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:1.0:1790740409.748921:0:5843:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000017b75644 reply state 000000002ecefb4e transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea09a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740409.748932:0:5843:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790740409.749072:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1b6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+25:10406:x1877727133076736:12345-192.168.203.58@tcp:36:bash.0 Request processed in 1786us (2064us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1790740409.749083:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 58 00000020:00080000:1.0:1790740409.749090:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790740409.756643:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea09a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740409.756668:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea09a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740409.756702:0:3289:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea09a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740409.756709:0:3289:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f976000 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740409.756714:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea09a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740409.756724:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea09a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740409.756756:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f0d98dcc200) 00010000:00010000:2.0:1790740409.756759:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740409.756765:0:3289:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea09a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740409.756772:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea09a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740409.765339:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740409.765651:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133076864 00000100:00100000:1.0:1790740409.765667:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133076864 00000100:00100000:1.0:1790740409.765732:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 59 00000100:00100000:1.0:1790740409.765754:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1b6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+24:10406:x1877727133076864:12345-192.168.203.58@tcp:101:bash.0 00010000:00010000:1.0:1790740409.765795:0:5844:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740409.765828:0:5844:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea0a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee4c4 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740409.766028:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea0a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740409.766052:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f000/0xc6b31a1b598ea08c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4bd expref: 25 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740409.766066:0:5844:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea0a8 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740409.766150:0:5844:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f000/0xc6b31a1b598ea08c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4bd expref: 25 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740409.766170:0:5844:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f000/0xc6b31a1b598ea08c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4bd expref: 25 pid: 8666 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740409.766192:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a40e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1877727158271744:192.168.203.58@tcp:104: 00000100:00100000:1.0:1790740409.766334:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d9921b540 going to sleep for 11 seconds 00000100:00100000:3.0:1790740409.774799:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740409.775051:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a40e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1877727158271744:192.168.203.58@tcp:104: 00010000:00010000:1.0:1790740409.775089:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea0a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740409.775181:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133076992 00000100:00100000:0.0:1790740409.775191:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133076992 00010000:00010000:0.0:1790740409.775251:0:5829:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f000/0xc6b31a1b598ea08c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4bd expref: 26 pid: 8666 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740409.775329:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 41 00000100:00100000:0.0:1790740409.775340:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec599375-3198-45fd-a23a-c5620f07177c+26:2370:x1877727133076992:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790740409.775361:0:5829:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740409.775370:0:5829:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f000/0xc6b31a1b598ea08c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4bd expref: 26 pid: 8666 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.775384:0:5829:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f000/0xc6b31a1b598ea08c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4bd expref: 26 pid: 8666 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.775410:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f000/0xc6b31a1b598ea08c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4bd expref: 26 pid: 8666 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.775428:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f0d98dcc200) 00010000:00010000:0.0:1790740409.775433:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea0a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.775444:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea0a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.775452:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea0a8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.775486:0:5829:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740409.775561:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec599375-3198-45fd-a23a-c5620f07177c+25:2370:x1877727133076992:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 223us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740409.775609:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 41 00010000:00010000:1.0:1790740409.775682:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea0a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740409.775691:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea0a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790740409.775762:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1790740409.775768:0:5844:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790740409.775797:0:5844:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea0a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740409.775837:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea0a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4c4 expref: 25 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740409.775861:0:5844:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea0a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4c4 expref: 24 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740409.775883:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f0d98dcc200) 00010000:00010000:1.0:1790740409.775886:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790740409.775889:0:5844:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9f976600, rc 0) 00000100:00100000:1.0:1790740409.775918:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1b6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+24:10406:x1877727133076864:12345-192.168.203.58@tcp:101:bash.0 Request processed in 10176us (10595us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740409.775926:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 59 00000100:00100000:2.0:1790740409.782176:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740409.782987:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133077248 00000100:00100000:0.0:1790740409.783021:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133077248 00000100:00100000:0.0:1790740409.783089:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 15 00000100:00100000:0.0:1790740409.783100:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0da2038450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+24:10406:x1877727133077248:12345-192.168.203.58@tcp:35:bash.0 00000100:00100000:0.0:1790740409.783438:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0da2038450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+25:10406:x1877727133077248:12345-192.168.203.58@tcp:35:bash.0 Request processed in 338us (1278us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1790740409.783448:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 15 00000100:00100000:3.0:1790740409.893095:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740409.893292:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133077504 00000100:00100000:0.0:1790740409.893305:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133077504 00000100:00100000:0.0:1790740409.893390:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 60 00000100:00100000:0.0:1790740409.893402:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+25:10416:x1877727133077504:12345-192.168.203.58@tcp:101:lfs.0 00010000:00010000:0.0:1790740409.893437:0:5842:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740409.893466:0:5842:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f000/0xc6b31a1b598ea0af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee4cb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740409.893949:0:5842:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1790740409.894111:0:5842:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f000/0xc6b31a1b598ea0af lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4cb expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740409.894126:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0d944f6d00) 00010000:00010000:2.0:1790740409.894129:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790740409.894135:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f000/0xc6b31a1b598ea0af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4cb expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740409.894170:0:5842:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0dc132f000, rc 0) 00000100:00100000:2.0:1790740409.894302:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+26:10416:x1877727133077504:12345-192.168.203.58@tcp:101:lfs.0 Request processed in 902us (1233us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1790740409.894312:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 60 00000100:00100000:3.0:1790740409.901881:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740409.902110:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133077632 00000100:00100000:0.0:1790740409.902124:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133077632 00000100:00100000:0.0:1790740409.902202:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 61 00000100:00100000:0.0:1790740409.902216:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+26:10416:x1877727133077632:12345-192.168.203.58@tcp:34:lfs.0 00010000:00010000:0.0:1790740409.902348:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea0bd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.902371:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea0bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.902385:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea0bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.902403:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fe00/0xc6b31a1b598ea0c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.902429:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fe00/0xc6b31a1b598ea0c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.902436:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fe00/0xc6b31a1b598ea0c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.902867:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fa00/0xc6b31a1b598ea0cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.902880:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fa00/0xc6b31a1b598ea0cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.902888:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fa00/0xc6b31a1b598ea0cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790740409.902943:0:8666:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fa00/0xc6b31a1b598ea0cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.902958:0:8666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea0bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.902966:0:8666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea0bd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.902973:0:8666:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea0bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.902981:0:8666:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132f800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1790740409.902986:0:8666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea0bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.902995:0:8666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea0bd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.903018:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f0d98dccb00) 00010000:00010000:0.0:1790740409.903021:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740409.903027:0:8666:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea0bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.903034:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea0bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.903048:0:8666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fe00/0xc6b31a1b598ea0c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.903055:0:8666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fe00/0xc6b31a1b598ea0c4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.903061:0:8666:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fe00/0xc6b31a1b598ea0c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.903066:0:8666:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132fe00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1790740409.903069:0:8666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fe00/0xc6b31a1b598ea0c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.903076:0:8666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fe00/0xc6b31a1b598ea0c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.903083:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8f0d82841600) 00010000:00010000:0.0:1790740409.903086:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740409.903089:0:8666:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fe00/0xc6b31a1b598ea0c4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.903094:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fe00/0xc6b31a1b598ea0c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.903123:0:8666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fa00/0xc6b31a1b598ea0cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.903130:0:8666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fa00/0xc6b31a1b598ea0cb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.903136:0:8666:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fa00/0xc6b31a1b598ea0cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.903142:0:8666:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132fa00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1790740409.903145:0:8666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fa00/0xc6b31a1b598ea0cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.903151:0:8666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fa00/0xc6b31a1b598ea0cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.903159:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f0d98dcc200) 00010000:00010000:0.0:1790740409.903162:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740409.903165:0:8666:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fa00/0xc6b31a1b598ea0cb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.903172:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fa00/0xc6b31a1b598ea0cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740409.903291:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+26:10416:x1877727133077632:12345-192.168.203.58@tcp:34:lfs.0 Request processed in 1076us (1422us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740409.903303:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 61 00000100:00100000:1.0:1790740409.905153:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740409.905239:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133077888 00000100:00100000:0.0:1790740409.905252:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133077888 00000100:00100000:0.0:1790740409.905326:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 16 00000100:00100000:0.0:1790740409.905354:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1a40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+26:10416:x1877727133077888:12345-192.168.203.58@tcp:35:lfs.0 00000100:00100000:0.0:1790740409.905698:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1a40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+27:10416:x1877727133077888:12345-192.168.203.58@tcp:35:lfs.0 Request processed in 345us (553us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1790740409.905706:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 16 00000100:00100000:3.0:1790740409.949820:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740409.949995:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133078144 00000100:00100000:1.0:1790740409.950008:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133078144 00000100:00100000:1.0:1790740409.950103:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 62 00000100:00100000:1.0:1790740409.950114:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+27:10419:x1877727133078144:12345-192.168.203.58@tcp:101:lfs.0 00010000:00010000:1.0:1790740409.950149:0:5843:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740409.950179:0:5843:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea0d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee4d2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740409.950294:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598ea0d9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740409.950312:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598ea0d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740409.950326:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598ea0d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740409.950344:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea0e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740409.950352:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea0e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740409.950379:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea0e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740409.950977:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6800/0xc6b31a1b598ea0e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740409.950990:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6800/0xc6b31a1b598ea0e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740409.950999:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6800/0xc6b31a1b598ea0e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790740409.951011:0:5843:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1790740409.951172:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598ea0d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740409.951182:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598ea0d9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740409.951190:0:5843:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598ea0d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740409.951197:0:5843:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f977000 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1790740409.951201:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598ea0d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740409.951209:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598ea0d9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740409.951232:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f0d98dccb00) 00010000:00010000:1.0:1790740409.951235:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740409.951249:0:5843:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598ea0d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740409.951256:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598ea0d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740409.951280:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea0e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740409.951286:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea0e0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740409.951291:0:5843:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea0e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740409.951296:0:5843:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f976000 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1790740409.951299:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea0e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740409.951304:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea0e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740409.951313:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8f0d84a1ea00) 00010000:00010000:1.0:1790740409.951315:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740409.951317:0:5843:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea0e0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740409.951323:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea0e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740409.951387:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea0d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4d2 expref: 30 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740409.951416:0:5843:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6800/0xc6b31a1b598ea0e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4d2 expref: 29 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740409.951424:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f0d98dcc200) 00010000:00010000:1.0:1790740409.951426:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790740409.951428:0:5843:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9fea6800, rc 0) 00000100:00100000:1.0:1790740409.951524:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+29:10419:x1877727133078144:12345-192.168.203.58@tcp:101:lfs.0 Request processed in 1411us (1720us total) trans 4294967347 rc 0/0 00000100:00100000:1.0:1790740409.951534:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 62 00000100:00100000:3.0:1790740409.956374:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740409.956499:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740409.956763:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133078400 00000100:00100000:2.0:1790740409.956776:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133078400 00000100:00100000:2.0:1790740409.956860:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 4 00000100:00100000:2.0:1790740409.956872:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec599375-3198-45fd-a23a-c5620f07177c+29:2370:x1877727133078400:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790740409.956890:0:5828:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740409.956920:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6800/0xc6b31a1b598ea0e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4d2 expref: 29 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740409.956943:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f0d98dcc200) 00010000:00010000:2.0:1790740409.956948:0:5828:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790740409.957015:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec599375-3198-45fd-a23a-c5620f07177c+28:2370:x1877727133078400:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 145us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740409.957023:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 4 00000100:00100000:0.0:1790740409.958552:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133078272 00000100:00100000:0.0:1790740409.958567:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133078272 00000100:00100000:0.0:1790740409.958776:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 63 00000100:00100000:0.0:1790740409.958787:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+28:10419:x1877727133078272:12345-192.168.203.58@tcp:54:lfs.0 00010000:00010000:0.0:1790740409.958872:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fa00/0xc6b31a1b598ea0f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.958896:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fa00/0xc6b31a1b598ea0f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.958909:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fa00/0xc6b31a1b598ea0f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.958942:0:8666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fa00/0xc6b31a1b598ea0f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.958950:0:8666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fa00/0xc6b31a1b598ea0f5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.958958:0:8666:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fa00/0xc6b31a1b598ea0f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.958965:0:8666:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132fa00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1790740409.958970:0:8666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fa00/0xc6b31a1b598ea0f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.961343:0:8666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fa00/0xc6b31a1b598ea0f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.961368:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f0d98dcc200) 00010000:00010000:0.0:1790740409.961372:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790740409.961379:0:8666:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fa00/0xc6b31a1b598ea0f5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740409.961387:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fa00/0xc6b31a1b598ea0f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740409.961538:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+28:10419:x1877727133078272:12345-192.168.203.58@tcp:54:lfs.0 Request processed in 2747us (5171us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740409.961551:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 63 00000100:00100000:3.0:1790740409.967441:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740409.968378:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133078656 00000100:00100000:0.0:1790740409.968394:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133078656 00000100:00100000:0.0:1790740409.968478:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 17 00000100:00100000:0.0:1790740409.968492:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+28:10419:x1877727133078656:12345-192.168.203.58@tcp:35:lfs.0 00000100:00100000:0.0:1790740409.969201:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+29:10419:x1877727133078656:12345-192.168.203.58@tcp:35:lfs.0 Request processed in 708us (1772us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1790740409.969212:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 17 00000100:00100000:3.0:1790740410.088235:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740410.088414:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133078912 00000100:00100000:1.0:1790740410.088431:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133078912 00000100:00100000:1.0:1790740410.088513:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 64 00000100:00100000:1.0:1790740410.088530:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+29:10436:x1877727133078912:12345-192.168.203.58@tcp:101:cat.0 00010000:00010000:1.0:1790740410.088559:0:5843:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740410.088631:0:5843:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6800/0xc6b31a1b598ea0fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee4d9 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.089392:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea103 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.089415:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea103 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.089431:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea103 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740410.089446:0:5843:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1790740410.089680:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6800/0xc6b31a1b598ea0fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4d9 expref: 32 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.089918:0:5843:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea103 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4d9 expref: 31 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.089930:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f0d98dcc200) 00010000:00010000:2.0:1790740410.089933:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1790740410.089937:0:5843:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d87595800, rc 0) 00000100:00100000:2.0:1790740410.090248:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+31:10436:x1877727133078912:12345-192.168.203.58@tcp:101:cat.0 Request processed in 1719us (2035us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1790740410.090258:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 64 00000100:00100000:1.0:1790740410.110734:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740410.110915:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133079040 00000100:00100000:0.0:1790740410.110930:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133079040 00000100:00100000:0.0:1790740410.112338:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 65 00000100:00100000:0.0:1790740410.112360:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1a40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+31:10438:x1877727133079040:12345-192.168.203.58@tcp:101:lfs.0 00010000:00010000:0.0:1790740410.112387:0:5844:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740410.112409:0:5844:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fa00/0xc6b31a1b598ea111 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee4e0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.112495:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fe00/0xc6b31a1b598ea118 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.112509:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fe00/0xc6b31a1b598ea118 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.112519:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fe00/0xc6b31a1b598ea118 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790740410.112553:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1790740410.112557:0:5844:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790740410.112596:0:5844:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fe00/0xc6b31a1b598ea118 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.112621:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fa00/0xc6b31a1b598ea111 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4e0 expref: 33 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.112638:0:5844:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fe00/0xc6b31a1b598ea118 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4e0 expref: 32 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.112646:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f0d98dccb00) 00010000:00010000:0.0:1790740410.112649:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790740410.112652:0:5844:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0dc132fe00, rc 0) 00000100:00100000:0.0:1790740410.112732:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1a40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+32:10438:x1877727133079040:12345-192.168.203.58@tcp:101:lfs.0 Request processed in 382us (2014us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740410.112739:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 65 00000100:00100000:3.0:1790740410.120021:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740410.121864:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133079424 00000100:00100000:2.0:1790740410.121879:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133079424 00000100:00100000:2.0:1790740410.122114:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 18 00000100:00100000:2.0:1790740410.122126:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec599375-3198-45fd-a23a-c5620f07177c+32:10438:x1877727133079424:12345-192.168.203.58@tcp:35:lfs.0 00000100:00100000:2.0:1790740410.122468:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec599375-3198-45fd-a23a-c5620f07177c+33:10438:x1877727133079424:12345-192.168.203.58@tcp:35:lfs.0 Request processed in 344us (2461us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1790740410.122477:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 18 00000100:00100000:3.0:1790740410.127975:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740410.129857:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133079552 00000100:00100000:0.0:1790740410.129871:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133079552 00000100:00100000:0.0:1790740410.129969:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 5 00000100:00100000:0.0:1790740410.129979:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec599375-3198-45fd-a23a-c5620f07177c+33:10438:x1877727133079552:12345-192.168.203.58@tcp:103:lfs.0 00010000:00010000:0.0:1790740410.129996:0:5829:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1790740410.130020:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea0a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4c4 expref: 33 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.130044:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea103 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4d9 expref: 32 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.130056:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598e9fac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee485 expref: 31 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.130064:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f0d98dcc200) 00010000:00010000:0.0:1790740410.130073:0:5829:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740410.130131:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec599375-3198-45fd-a23a-c5620f07177c+30:10438:x1877727133079552:12345-192.168.203.58@tcp:103:lfs.0 Request processed in 153us (2165us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740410.130139:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 5 00000100:00100000:1.0:1790740410.140942:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740410.147886:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133079680 00000100:00100000:3.0:1790740410.147909:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133079680 00000100:00100000:3.0:1790740410.147982:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 66 00000100:00100000:3.0:1790740410.147992:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1a41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+30:10438:x1877727133079680:12345-192.168.203.58@tcp:58:lfs.0 00010000:00010000:3.0:1790740410.148135:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e800/0xc6b31a1b598ea11f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740410.148151:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e800/0xc6b31a1b598ea11f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740410.148163:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e800/0xc6b31a1b598ea11f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790740410.149530:0:5842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790740410.150869:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1790740410.150964:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1790740410.153342:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1a41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+30:10438:x1877727133079680:12345-192.168.203.58@tcp:58:lfs.0 Request processed in 5341us (12399us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740410.153356:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 66 00000100:00100000:1.0:1790740410.199325:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740410.199434:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133079808 00000100:00100000:0.0:1790740410.199444:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133079808 00000100:00100000:0.0:1790740410.199506:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 67 00000100:00100000:0.0:1790740410.199517:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1a41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+30:10440:x1877727133079808:12345-192.168.203.58@tcp:101:lfs.0 00010000:00010000:0.0:1790740410.199537:0:5844:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740410.199559:0:5844:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fa00/0xc6b31a1b598ea126 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee4e7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.199682:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea12d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.199716:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea12d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.199728:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea12d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.199942:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fc00/0xc6b31a1b598ea134 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.199953:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fc00/0xc6b31a1b598ea134 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.199961:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fc00/0xc6b31a1b598ea134 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.200190:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e400/0xc6b31a1b598ea13b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.200200:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e400/0xc6b31a1b598ea13b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.200207:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e400/0xc6b31a1b598ea13b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790740410.200253:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1790740410.200259:0:5844:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790740410.200279:0:5844:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e400/0xc6b31a1b598ea13b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.200292:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e400/0xc6b31a1b598ea13b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.200313:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea12d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.200319:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea12d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.200327:0:5844:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea12d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.200332:0:5844:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132f800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1790740410.200338:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea12d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.200345:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea12d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.200357:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f0d98dccb00) 00010000:00010000:0.0:1790740410.200360:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740410.200365:0:5844:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea12d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.200372:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea12d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.200383:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fc00/0xc6b31a1b598ea134 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.200389:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fc00/0xc6b31a1b598ea134 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.200394:0:5844:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fc00/0xc6b31a1b598ea134 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.200406:0:5844:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132fc00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1790740410.200409:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fc00/0xc6b31a1b598ea134 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.200416:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fc00/0xc6b31a1b598ea134 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.200424:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8f0d82841600) 00010000:00010000:0.0:1790740410.200427:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740410.200430:0:5844:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fc00/0xc6b31a1b598ea134 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.200435:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fc00/0xc6b31a1b598ea134 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.200473:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fa00/0xc6b31a1b598ea126 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4e7 expref: 32 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.200486:0:5844:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e400/0xc6b31a1b598ea13b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4e7 expref: 31 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.200494:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f0d944f6c00) 00010000:00010000:0.0:1790740410.200497:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790740410.200499:0:5844:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0dc132e400, rc 0) 00000100:00100000:0.0:1790740410.201614:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1a41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+31:10440:x1877727133079808:12345-192.168.203.58@tcp:101:lfs.0 Request processed in 2093us (2292us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740410.201624:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 67 00000040:00080000:2.0:1790740410.544802:0:11679:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790740410.544812:0:11679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790740410.544867:0:11679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1790740410.544874:0:11679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790740410.545012:0:11679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1b6e680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11679:1877727158271872:192.168.203.58@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790740410.545113:0:11679:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d8956f240 going to sleep for 11 seconds 00000100:00100000:2.0:1790740410.550184:0:11679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1b6e680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11679:1877727158271872:192.168.203.58@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790740410.564372:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740410.564921:0:5854:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133079936 00000100:00100000:1.0:1790740410.564931:0:5854:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133079936 00000100:00100000:1.0:1790740410.564994:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 1 00000100:00100000:1.0:1790740410.565005:0:5854:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8812ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ec599375-3198-45fd-a23a-c5620f07177c+31:10451:x1877727133079936:12345-192.168.203.58@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1790740410.565132:0:5854:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8812ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ec599375-3198-45fd-a23a-c5620f07177c+31:10451:x1877727133079936:12345-192.168.203.58@tcp:900:lhsmtool_posix.0 Request processed in 129us (1687us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740410.565154:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 1 00000100:00100000:3.0:1790740410.574851:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740410.574990:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133080064 00000100:00100000:0.0:1790740410.575010:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133080064 00000100:00100000:0.0:1790740410.575067:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 68 00000100:00100000:0.0:1790740410.575084:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8812c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+31:10451:x1877727133080064:12345-192.168.203.58@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790740410.575115:0:5843:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790740410.575253:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8812c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+31:10451:x1877727133080064:12345-192.168.203.58@tcp:53:lhsmtool_posix.0 Request processed in 171us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740410.575262:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 68 00000100:00100000:0.0:1790740410.589295:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740410.589796:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133080192 00000100:00100000:2.0:1790740410.589807:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133080192 00000100:00100000:2.0:1790740410.589858:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 69 00000100:00100000:2.0:1790740410.589868:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1291880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+31:10451:x1877727133080192:12345-192.168.203.58@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1790740410.589936:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598ea142 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.589954:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598ea142 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.589966:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598ea142 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.589991:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea149 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.590000:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea149 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.590007:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea149 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.590033:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598ea150 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.590042:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598ea150 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.590048:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598ea150 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740410.590081:0:8666:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1790740410.590093:0:8666:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790740410.590109:0:8666:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598ea150 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.590121:0:8666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598ea142 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.590128:0:8666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598ea142 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.590136:0:8666:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598ea142 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.590142:0:8666:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87595e00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740410.590147:0:8666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598ea142 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.590155:0:8666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598ea142 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.590166:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f0d944f6600) 00010000:00010000:2.0:1790740410.590170:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740410.590174:0:8666:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598ea142 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.590180:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598ea142 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.590192:0:8666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea149 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.590198:0:8666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea149 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.590224:0:8666:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea149 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.590230:0:8666:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87594e00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740410.590233:0:8666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea149 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.590240:0:8666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea149 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.590248:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff8f0d98dcc100) 00010000:00010000:2.0:1790740410.590250:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740410.590253:0:8666:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea149 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.590258:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea149 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.590273:0:8666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598ea150 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.590280:0:8666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598ea150 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.590301:0:8666:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598ea150 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.590307:0:8666:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87595c00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740410.590310:0:8666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598ea150 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.590331:0:8666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598ea150 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.590341:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f0d944f6c00) 00010000:00010000:2.0:1790740410.590344:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740410.590348:0:8666:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598ea150 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.590354:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598ea150 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740410.590455:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1291880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+31:10451:x1877727133080192:12345-192.168.203.58@tcp:34:lhsmtool_posix.0 Request processed in 577us (1158us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740410.590463:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 69 00000100:00100000:2.0:1790740410.593720:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740410.593851:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133080448 00000100:00100000:0.0:1790740410.593861:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133080448 00000100:00100000:0.0:1790740410.593915:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 70 00000100:00100000:0.0:1790740410.593926:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1b6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+31:10451:x1877727133080448:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790740410.593946:0:5843:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740410.593967:0:5843:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea157 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee4ee expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.594081:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598ea15e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.594097:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598ea15e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.594107:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598ea15e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790740410.594118:0:5843:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1790740410.594226:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598ea15e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.594247:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598ea15e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.594255:0:5843:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598ea15e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.594261:0:5843:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132ee00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1790740410.594266:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598ea15e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.594273:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598ea15e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.594535:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f0d944f6c00) 00010000:00010000:0.0:1790740410.594540:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790740410.594546:0:5843:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598ea15e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.594553:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598ea15e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.594649:0:5843:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea157 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4ee expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.594659:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f0d944f6600) 00010000:00010000:0.0:1790740410.594662:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790740410.594665:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea157 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4ee expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.594675:0:5843:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0dc132f800, rc 0) 00000100:00100000:0.0:1790740410.594752:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1b6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+32:10451:x1877727133080448:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 Request processed in 818us (1030us total) trans 4294967351 rc 301/301 00000100:00100000:0.0:1790740410.594761:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 70 00000100:00100000:2.0:1790740410.605210:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740410.605309:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133080576 00000100:00100000:3.0:1790740410.605319:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133080576 00000100:00100000:3.0:1790740410.605412:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 71 00000100:00100000:3.0:1790740410.605423:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1b6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+32:10451:x1877727133080576:12345-192.168.203.58@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790740410.605470:0:8666:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790740410.605595:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1b6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+32:10451:x1877727133080576:12345-192.168.203.58@tcp:53:lhsmtool_posix.0 Request processed in 152us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740410.605603:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 71 00000100:00100000:0.0:1790740410.613194:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740410.618596:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133080832 00000100:00100000:1.0:1790740410.618616:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133080832 00000100:00100000:1.0:1790740410.619552:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 72 00000100:00100000:1.0:1790740410.619569:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+32:10451:x1877727133080832:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790740410.619623:0:5843:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740410.619626:0:5843:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1790740410.619849:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fe00/0xc6b31a1b598ea118 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4e0 expref: 32 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740410.619868:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f0d98dccb00) 00010000:00010000:1.0:1790740410.619872:0:5843:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790740410.619888:0:5843:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6a00/0xc6b31a1b598ea16c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee4f5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790740410.621016:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1790740410.621276:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6800/0xc6b31a1b598ea173 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740410.621292:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6800/0xc6b31a1b598ea173 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740410.621304:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6800/0xc6b31a1b598ea173 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740410.621364:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6a00/0xc6b31a1b598ea16c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4f5 expref: 34 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740410.621393:0:5843:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6800/0xc6b31a1b598ea173 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4f5 expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740410.621402:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8f0d84a1ea00) 00010000:00010000:1.0:1790740410.621404:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790740410.621407:0:5843:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9fea6800, rc 0) 00000100:00100000:1.0:1790740410.621949:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+33:10451:x1877727133080832:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 Request processed in 2384us (8761us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1790740410.621959:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 72 00000100:00100000:2.0:1790740410.625054:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740410.625171:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133081088 00000100:00100000:3.0:1790740410.625181:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133081088 00000100:00100000:3.0:1790740410.625246:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 73 00000100:00100000:3.0:1790740410.625256:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1b6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+33:10451:x1877727133081088:12345-192.168.203.58@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790740410.625312:0:5844:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740410.625338:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6800/0xc6b31a1b598ea173 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4f5 expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740410.625357:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8f0d84a1ea00) 00010000:00010000:3.0:1790740410.625368:0:5844:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790740410.625388:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea181 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740410.625401:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea181 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740410.625424:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea181 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740410.625494:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea188 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x88a96cd7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740410.625503:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea188 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x88a96cd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740410.625510:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea188 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x88a96cd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740410.625719:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea181 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740410.625729:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea181 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740410.625736:0:5844:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea181 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740410.625912:0:5844:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0e000 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1790740410.625917:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea181 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740410.625925:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea181 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740410.625934:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f0d98dccb00) 00010000:00010000:3.0:1790740410.625937:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740410.625942:0:5844:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea181 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740410.625955:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea181 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740410.625966:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea188 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x88a96cd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740410.625971:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea188 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x88a96cd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740410.625977:0:5844:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea188 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x88a96cd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740410.626049:0:5844:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0ee00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1790740410.626052:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea188 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x88a96cd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740410.626059:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea188 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x88a96cd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740410.626067:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x88a96cd7 (ffff8f0d944f6100) 00010000:00010000:3.0:1790740410.626070:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740410.626073:0:5844:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea188 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x88a96cd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740410.626079:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea188 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x88a96cd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740410.626192:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1b6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+32:10451:x1877727133081088:12345-192.168.203.58@tcp:36:lhsmtool_posix.0 Request processed in 936us (1145us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790740410.626201:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 73 00000100:00100000:2.0:1790740410.636230:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740410.638860:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133081216 00000100:00100000:3.0:1790740410.638872:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133081216 00000100:00100000:3.0:1790740410.638930:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 74 00000100:00100000:3.0:1790740410.638941:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d86549f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+32:10451:x1877727133081216:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790740410.638960:0:5842:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740410.638994:0:5842:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fa00/0xc6b31a1b598ea18f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee4fc expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740410.639029:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fc00/0xc6b31a1b598ea196 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740410.639044:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fc00/0xc6b31a1b598ea196 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740410.639058:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fc00/0xc6b31a1b598ea196 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740410.639143:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fa00/0xc6b31a1b598ea18f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4fc expref: 34 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740410.639160:0:5842:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fc00/0xc6b31a1b598ea196 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4fc expref: 33 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740410.639170:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8f0d944f6f00) 00010000:00010000:3.0:1790740410.639173:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790740410.639176:0:5842:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0db6c0fc00, rc 0) 00000100:00100000:3.0:1790740410.639244:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d86549f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+33:10451:x1877727133081216:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 Request processed in 305us (3034us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740410.639252:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 74 00000100:00100000:0.0:1790740410.644531:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740410.644894:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133081472 00000100:00100000:3.0:1790740410.644904:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133081472 00000100:00100000:3.0:1790740410.644963:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 75 00000100:00100000:3.0:1790740410.644973:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1291180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+33:10451:x1877727133081472:12345-192.168.203.58@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790740410.645073:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea19d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740410.645092:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea19d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740410.645104:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea19d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790740410.645372:0:8666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:3.0:1790740410.645382:0:8666:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 326595808672ns, next at 327595806308ns, rc = 0 00000004:00010000:3.0:1790740410.645452:0:8666:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000003bd427fe reply state 000000004dc61c44 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea19d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740410.645462:0:8666:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790740410.645554:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1291180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+35:10451:x1877727133081472:12345-192.168.203.58@tcp:36:lhsmtool_posix.0 Request processed in 581us (1031us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1790740410.645563:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 75 00000100:00100000:3.0:1790740410.650526:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740410.650560:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133081600 00000100:00100000:3.0:1790740410.650584:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133081600 00000100:00100000:3.0:1790740410.650629:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 76 00000100:00100000:3.0:1790740410.650639:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8812f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+35:10451:x1877727133081600:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790740410.650662:0:5842:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740410.650682:0:5842:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea1a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee503 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740410.650751:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea1a4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee503 expref: 36 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740410.650766:0:5842:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea1a4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee503 expref: 36 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740410.650785:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8f0d944f6f00) 00010000:00010000:3.0:1790740410.650788:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790740410.650792:0:5842:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0db6c0e000, rc 0) 00000100:00100000:3.0:1790740410.650846:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8812f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+36:10451:x1877727133081600:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 Request processed in 208us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740410.650853:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 76 00010000:00010000:0.0:1790740410.650994:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea19d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.651004:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea19d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.651012:0:3290:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea19d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.651019:0:3290:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0ee00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1790740410.651024:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea19d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.651032:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea19d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.651043:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8f0d944f6f00) 00010000:00010000:0.0:1790740410.651046:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790740410.651050:0:3290:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea19d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.651057:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea19d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740410.660868:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740410.660996:0:8460:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133081728 00000100:00100000:1.0:1790740410.661006:0:8460:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133081728 00000100:00100000:1.0:1790740410.661053:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 25 00000100:00100000:1.0:1790740410.661061:0:8460:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd03e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2368:x1877727133081728:12345-192.168.203.58@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1790740410.661092:0:8460:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from ec599375-3198-45fd-a23a-c5620f07177c@192.168.203.58@tcp t0 exp 0000000000000000 cur 326 last 0 00000020:00000080:1.0:1790740410.661119:0:8460:0:(genops.c:1384:class_connect()) connect: client ec599375-3198-45fd-a23a-c5620f07177c, cookie 0xc6b31a1b598ea1ab 00002000:00100000:1.0:1790740410.661130:0:8460:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ec599375-3198-45fd-a23a-c5620f07177c/ffff8f0dc110e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b03 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1790740410.661151:0:8460:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1790740410.661374:0:8460:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1790740410.661402:0:8460:0:(import.c:65:import_set_state_nolock()) ffff8f0dc110c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790740410.661463:0:8460:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd03e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec599375-3198-45fd-a23a-c5620f07177c+6:2368:x1877727133081728:12345-192.168.203.58@tcp:8:lhsmtool_posix.0 Request processed in 401us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740410.661471:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 25 00000100:00100000:3.0:1790740410.665009:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740410.665046:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133081856 00000100:00100000:3.0:1790740410.665056:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133081856 00000100:00100000:3.0:1790740410.665112:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 26 00000100:00100000:3.0:1790740410.665122:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd03d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec599375-3198-45fd-a23a-c5620f07177c+6:0:x1877727133081856:12345-192.168.203.58@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1790740410.665361:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1790740410.676670:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1790740410.694130:0:7642:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ec599375-3198-45fd-a23a-c5620f07177c 00000001:00080000:2.0:1790740410.694148:0:7642:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:3.0:1790740410.695292:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd03d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec599375-3198-45fd-a23a-c5620f07177c+5:0:x1877727133081856:12345-192.168.203.58@tcp:2:lhsmtool_posix.0 Request processed in 30166us (30285us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1790740410.695304:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 26 00000100:00100000:0.0:1790740410.701741:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740410.701883:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133082112 00000100:00100000:1.0:1790740410.701893:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133082112 00000100:00100000:1.0:1790740410.701963:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 19 00000100:00100000:1.0:1790740410.701973:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+35:10451:x1877727133082112:12345-192.168.203.58@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1790740410.702187:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+36:10451:x1877727133082112:12345-192.168.203.58@tcp:35:lhsmtool_posix.0 Request processed in 214us (455us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1790740410.702195:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 19 00000100:00100000:2.0:1790740410.708348:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740410.708383:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133082368 00000100:00100000:2.0:1790740410.708392:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133082368 00000100:00100000:2.0:1790740410.708439:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 77 00000100:00100000:2.0:1790740410.708449:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8654aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+36:10451:x1877727133082368:12345-192.168.203.58@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1790740410.708549:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8654aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+36:10451:x1877727133082368:12345-192.168.203.58@tcp:57:lhsmtool_posix.0 Request processed in 101us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740410.708569:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 77 00000100:00100000:2.0:1790740410.722796:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740410.722833:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133082496 00000100:00100000:2.0:1790740410.722842:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133082496 00000100:00100000:2.0:1790740410.722893:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 78 00000100:00100000:2.0:1790740410.722903:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8498f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+36:10451:x1877727133082496:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790740410.722922:0:5842:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740410.722943:0:5842:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598ea1b2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee50a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.723012:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594600/0xc6b31a1b598ea1b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.723026:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594600/0xc6b31a1b598ea1b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.723038:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594600/0xc6b31a1b598ea1b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740410.723072:0:5842:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790740410.723090:0:5842:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594600/0xc6b31a1b598ea1b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.723115:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598ea1b2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee50a expref: 38 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.723131:0:5842:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594600/0xc6b31a1b598ea1b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee50a expref: 37 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.723154:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8f0d944f6f00) 00010000:00010000:2.0:1790740410.723158:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1790740410.723162:0:5842:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d87594600, rc 0) 00000100:00100000:2.0:1790740410.723227:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8498f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+37:10451:x1877727133082496:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 Request processed in 314us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740410.723235:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 78 00000100:00100000:3.0:1790740410.731061:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740410.731264:0:8460:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133082624 00000100:00100000:1.0:1790740410.731274:0:8460:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133082624 00000100:00100000:1.0:1790740410.731326:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 27 00000100:00100000:1.0:1790740410.731336:0:8460:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd03d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec599375-3198-45fd-a23a-c5620f07177c+5:2370:x1877727133082624:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790740410.731352:0:8460:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740410.731375:0:8460:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df33269c/0xc6b31a1b598ea1c0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee511 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790740410.731399:0:8460:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abc87ba, blocks: 0x1 00010000:00010000:1.0:1790740410.731417:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=326s v=(0 0) 00010000:00010000:1.0:1790740410.731422:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790740410.731430:0:8460:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df33269c/0xc6b31a1b598ea1c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee511 expref: 6 pid: 8460 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740410.731449:0:8460:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000df33269c/0xc6b31a1b598ea1c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee511 expref: 6 pid: 8460 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740410.731463:0:8460:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9fea6a00, rc 0) 00000100:00100000:1.0:1790740410.731519:0:8460:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd03d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec599375-3198-45fd-a23a-c5620f07177c+6:2370:x1877727133082624:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 Request processed in 184us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740410.731539:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 27 00000100:00100000:3.0:1790740410.736200:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740410.736300:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133082880 00000100:00100000:1.0:1790740410.736311:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133082880 00000100:00100000:1.0:1790740410.736365:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 79 00000100:00100000:1.0:1790740410.736374:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+37:10451:x1877727133082880:12345-192.168.203.58@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1790740410.736478:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+37:10451:x1877727133082880:12345-192.168.203.58@tcp:57:lhsmtool_posix.0 Request processed in 104us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740410.736485:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 79 00000100:00100000:1.0:1790740410.755549:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740410.755720:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133083008 00000100:00100000:3.0:1790740410.755730:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133083008 00000100:00100000:3.0:1790740410.755795:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 28 00000100:00100000:3.0:1790740410.755806:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1a40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec599375-3198-45fd-a23a-c5620f07177c+6:10451:x1877727133083008:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790740410.755825:0:6701:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740410.755842:0:6701:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000508d168/0xc6b31a1b598ea1c7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee518 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740410.755873:0:6701:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000df33269c/0xc6b31a1b598ea1c0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee511 expref: 7 pid: 8460 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740410.755884:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790740410.755887:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790740410.755893:0:6701:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000508d168/0xc6b31a1b598ea1c7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee518 expref: 7 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740410.755926:0:6701:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000df33269c/0xc6b31a1b598ea1c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee511 expref: 7 pid: 8460 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740410.755940:0:6701:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000df33269c/0xc6b31a1b598ea1c0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee511 expref: 7 pid: 8460 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740410.755955:0:6701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbee6f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6701:1877727158272000:192.168.203.58@tcp:104: 00000100:00100000:3.0:1790740410.756041:0:6701:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0db6f3bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790740410.767153:0:6701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbee6f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6701:1877727158272000:192.168.203.58@tcp:104: 00010000:00010000:3.0:1790740410.767189:0:6701:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000508d168/0xc6b31a1b598ea1c7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee518 expref: 7 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740410.767236:0:6701:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0db6c0e600, rc 0) 00000100:00100000:3.0:1790740410.767294:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1a40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec599375-3198-45fd-a23a-c5620f07177c+7:10451:x1877727133083008:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 Request processed in 11489us (11753us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740410.767313:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 28 00000100:00100000:1.0:1790740410.767632:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740410.767667:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133083136 00000100:00100000:1.0:1790740410.767675:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133083136 00010000:00010000:1.0:1790740410.767709:0:5828:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000df33269c/0xc6b31a1b598ea1c0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee511 expref: 7 pid: 8460 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740410.767739:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 42 00000100:00100000:1.0:1790740410.767748:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d87403850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec599375-3198-45fd-a23a-c5620f07177c+7:2369:x1877727133083136:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790740410.767763:0:5828:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740410.767790:0:5828:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000df33269c/0xc6b31a1b598ea1c0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee511 expref: 7 pid: 8460 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740410.767803:0:5828:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000df33269c/0xc6b31a1b598ea1c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee511 expref: 7 pid: 8460 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740410.767824:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df33269c/0xc6b31a1b598ea1c0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee511 expref: 7 pid: 8460 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740410.767845:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790740410.767849:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790740410.767857:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000508d168/0xc6b31a1b598ea1c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee518 expref: 6 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740410.767867:0:5828:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000508d168/0xc6b31a1b598ea1c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee518 expref: 6 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740410.767902:0:5828:0:(ldlm_lockd.c:1085:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000508d168/0xc6b31a1b598ea1c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee518 expref: 6 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740410.767916:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db6dc0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5828:1877727158272128:192.168.203.58@tcp:105: 00000100:00100000:1.0:1790740410.767966:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0db6ff6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790740410.784799:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740410.785016:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133083264 00000100:00100000:3.0:1790740410.785025:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133083264 00002000:00100000:3.0:1790740410.785072:0:6707:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8f0dc1293800 x1877727133083264/t0(0) o4->ec599375-3198-45fd-a23a-c5620f07177c@192.168.203.58@tcp:466/0 lens 504/0 e 0 to 0 dl 1790740421 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790740410.785084:0:6707:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f0dc1293800 with x1877727133083264 ext(0->8) 00002000:00010000:3.0:1790740410.785090:0:6707:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f0dc1293800 00000100:00100000:3.0:1790740410.785123:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 0 00000100:00100000:3.0:1790740410.785132:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1293800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ec599375-3198-45fd-a23a-c5620f07177c+7:2370:x1877727133083264:12345-192.168.203.58@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1790740410.785812:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1293800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ec599375-3198-45fd-a23a-c5620f07177c+9:2370:x1877727133083264:12345-192.168.203.58@tcp:4:lhsmtool_posix.0 Request processed in 677us (1018us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1790740410.785820:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 0 00002000:00100000:3.0:1790740410.785828:0:6707:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8f0dc1293800 x1877727133083264/t4294967302(0) o4->ec599375-3198-45fd-a23a-c5620f07177c@192.168.203.58@tcp:466/0 lens 504/448 e 0 to 0 dl 1790740421 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790740410.785837:0:6707:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f0dc1293800 with x1877727133083264 ext(0->8) 00002000:00010000:3.0:1790740410.785840:0:6707:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f0dc1293800 00000100:00100000:2.0:1790740410.787253:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db6dc0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5828:1877727158272128:192.168.203.58@tcp:105: 00010000:00010000:2.0:1790740410.787277:0:5828:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740410.787553:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d87403850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec599375-3198-45fd-a23a-c5620f07177c+8:2369:x1877727133083136:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 19804us (19920us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740410.787564:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 42 00000100:00100000:0.0:1790740410.796232:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740410.796401:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133083392 00000100:00100000:2.0:1790740410.796411:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133083392 00000100:00100000:2.0:1790740410.796480:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 80 00000100:00100000:2.0:1790740410.796490:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1290380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+37:10451:x1877727133083392:12345-192.168.203.58@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1790740410.831220:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1290380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+37:10451:x1877727133083392:12345-192.168.203.58@tcp:44:lhsmtool_posix.0 Request processed in 34711us (34986us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740410.831235:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 80 00000001:00080000:0.0:1790740410.831278:0:5865:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967351 is committed 00000001:00080000:0.0:1790740410.831305:0:5865:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:0.0:1790740410.831332:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1790740410.831356:0:5865:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:3.0:1790740410.831558:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:3.0:1790740410.831597:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1790740410.831749:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d8498fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158272256:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1790740410.831806:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740410.831978:0:8460:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158272256 00000100:00100000:2.0:1790740410.831987:0:8460:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158272256 00000100:00100000:2.0:1790740410.832052:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790740410.832061:0:8460:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1a43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158272256:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1790740410.832221:0:8460:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1790740410.832224:0:8460:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1790740410 00002000:00010000:2.0:1790740410.832227:0:8460:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1790740410.832229:0:8460:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1790740410 -> 1790740410 00002000:00010000:2.0:1790740410.832231:0:8460:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1790740410.832274:0:8460:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1a43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3304:x1877727158272256:12345-0@lo:2:osp-syn-1-0.0 Request processed in 215us (468us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1790740410.832281:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:2.0:1790740410.832334:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f0d8498fb80/2, rc 0, transno 4294967303 00000100:00100000:2.0:1790740410.832341:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d8498fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158272256:0@lo:2:osp-syn-1-0.0 00000100:00080000:3.0:1790740410.832398:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790740410.838425:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740410.838504:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133083520 00000100:00100000:3.0:1790740410.838524:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133083520 00000100:00100000:3.0:1790740410.838612:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 30 00000100:00100000:3.0:1790740410.838624:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db6dc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec599375-3198-45fd-a23a-c5620f07177c+8:2370:x1877727133083520:12345-192.168.203.58@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1790740410.910637:0:7642:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:3.0:1790740410.910657:0:7642:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:2.0:1790740410.910720:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db6dc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec599375-3198-45fd-a23a-c5620f07177c+6:2370:x1877727133083520:12345-192.168.203.58@tcp:16:lhsmtool_posix.0 Request processed in 72094us (72297us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740410.910731:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 30 00000100:00100000:1.0:1790740410.916386:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740410.916618:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133083776 00000100:00100000:3.0:1790740410.916627:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133083776 00000100:00100000:3.0:1790740410.916689:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 81 00000100:00100000:3.0:1790740410.916698:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db6dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+13:10451:x1877727133083776:12345-192.168.203.58@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790740410.916762:0:8666:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740410.916787:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594600/0xc6b31a1b598ea1b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee50a expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740410.916804:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8f0d944f6f00) 00010000:00010000:3.0:1790740410.916809:0:8666:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790740410.916836:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598ea1ce lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740410.916849:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598ea1ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740410.916858:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598ea1ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790740410.917108:0:8666:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000000ac8659e reply state 00000000900c8987 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598ea1ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740410.917118:0:8666:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790740410.917223:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db6dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+14:10451:x1877727133083776:12345-192.168.203.58@tcp:36:lhsmtool_posix.0 Request processed in 512us (832us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1790740410.917237:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 81 00010000:00010000:0.0:1790740410.920256:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598ea1ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.920274:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598ea1ce lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.920282:0:3289:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598ea1ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.920290:0:3289:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0f600 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1790740410.920294:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598ea1ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.920303:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598ea1ce lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.920318:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8f0d944f6f00) 00010000:00010000:0.0:1790740410.920330:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740410.920335:0:3289:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598ea1ce lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.920341:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598ea1ce lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740410.924790:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740410.924868:0:8460:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133083904 00000100:00100000:2.0:1790740410.924877:0:8460:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133083904 00000100:00100000:2.0:1790740410.924932:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 31 00000100:00100000:2.0:1790740410.924942:0:8460:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1b6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec599375-3198-45fd-a23a-c5620f07177c+6:2369:x1877727133083904:12345-192.168.203.58@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1790740410.925179:0:8460:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1790740410.925183:0:8460:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1790740410 -> 1790740409 00002000:00010000:2.0:1790740410.925185:0:8460:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1790740408 00002000:00010000:2.0:1790740410.925187:0:8460:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1790740410 -> 1790740409 00002000:00010000:2.0:1790740410.925189:0:8460:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1790740410.925258:0:8460:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1b6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec599375-3198-45fd-a23a-c5620f07177c+7:2369:x1877727133083904:12345-192.168.203.58@tcp:2:lhsmtool_posix.0 Request processed in 317us (477us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1790740410.925266:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 31 00000100:00100000:3.0:1790740410.929568:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740410.929683:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133084160 00000100:00100000:2.0:1790740410.929697:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133084160 00000100:00100000:2.0:1790740410.929745:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 82 00000100:00100000:2.0:1790740410.929762:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+13:10451:x1877727133084160:12345-192.168.203.58@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1790740410.929833:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea1d5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.929851:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fc00/0xc6b31a1b598ea196 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4fc expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.929879:0:5843:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea1d5 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.929932:0:5843:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fc00/0xc6b31a1b598ea196 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4fc expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.929946:0:5843:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fc00/0xc6b31a1b598ea196 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4fc expref: 13 pid: 5842 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740410.929959:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc12aca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1877727158272384:192.168.203.58@tcp:104: 00000100:00100000:2.0:1790740410.930048:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d9921b180 going to sleep for 11 seconds 00000100:00100000:2.0:1790740410.934318:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740410.934359:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc12aca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1877727158272384:192.168.203.58@tcp:104: 00010000:00010000:3.0:1790740410.934387:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea1d5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740410.934696:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133084288 00000100:00100000:0.0:1790740410.934704:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133084288 00010000:00010000:0.0:1790740410.934751:0:5829:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fc00/0xc6b31a1b598ea196 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4fc expref: 14 pid: 5842 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740410.934789:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 43 00000100:00100000:0.0:1790740410.934799:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc12ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec599375-3198-45fd-a23a-c5620f07177c+14:2370:x1877727133084288:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790740410.934812:0:5829:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740410.934819:0:5829:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fc00/0xc6b31a1b598ea196 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4fc expref: 14 pid: 5842 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.934831:0:5829:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fc00/0xc6b31a1b598ea196 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4fc expref: 14 pid: 5842 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.934853:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fc00/0xc6b31a1b598ea196 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4fc expref: 14 pid: 5842 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.934870:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8f0d944f6f00) 00010000:00010000:0.0:1790740410.934875:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea1d5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.934902:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea1d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.934910:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea1d5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.934940:0:5829:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790740410.934957:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea1d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.934963:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea1d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740410.934990:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc12ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec599375-3198-45fd-a23a-c5620f07177c+13:2370:x1877727133084288:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 193us (683us total) trans 0 rc 0/0 00010000:00010000:2.0:1790740410.934992:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea1d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740410.934998:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 43 00010000:00010000:2.0:1790740410.934999:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea1d5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.935006:0:5843:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea1d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.935011:0:5843:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87594800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740410.935016:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea1d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.935031:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea1d5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.935041:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8f0d944f6f00) 00010000:00010000:2.0:1790740410.935043:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1790740410.935047:0:5843:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea1d5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.935053:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea1d5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740410.935093:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+12:10451:x1877727133084160:12345-192.168.203.58@tcp:55:lhsmtool_posix.0 Request processed in 5332us (5533us total) trans 0 rc -22/-22 00000100:00100000:2.0:1790740410.935102:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 82 00000100:00100000:0.0:1790740410.940480:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740410.942341:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133084416 00000100:00100000:1.0:1790740410.942354:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133084416 00000100:00100000:1.0:1790740410.942413:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 32 00000100:00100000:1.0:1790740410.942423:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1b6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec599375-3198-45fd-a23a-c5620f07177c+7:2369:x1877727133084416:12345-192.168.203.58@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1790740410.942464:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000034db2d06/0xc6b31a1b598ea1dc lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740410.942485:0:6701:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000508d168/0xc6b31a1b598ea1c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee518 expref: 7 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740410.942506:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790740410.942511:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790740410.942516:0:6701:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034db2d06/0xc6b31a1b598ea1dc lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740410.942548:0:6701:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000508d168/0xc6b31a1b598ea1c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee518 expref: 7 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740410.942562:0:6701:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000508d168/0xc6b31a1b598ea1c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee518 expref: 7 pid: 6701 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740410.942607:0:6701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db6dc3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6701:1877727158272512:192.168.203.58@tcp:104: 00000100:00100000:1.0:1790740410.942691:0:6701:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d875736c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790740410.952972:0:6701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db6dc3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6701:1877727158272512:192.168.203.58@tcp:104: 00010000:00010000:1.0:1790740410.953003:0:6701:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000034db2d06/0xc6b31a1b598ea1dc lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740410.961494:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740410.961655:0:8506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133084544 00000100:00100000:3.0:1790740410.961667:0:8506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133084544 00010000:00010000:3.0:1790740410.961709:0:8506:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000508d168/0xc6b31a1b598ea1c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee518 expref: 8 pid: 6701 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740410.961745:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 44 00000100:00100000:3.0:1790740410.962348:0:8506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db6dc3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec599375-3198-45fd-a23a-c5620f07177c+8:2369:x1877727133084544:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790740410.962364:0:8506:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740410.962386:0:8506:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000508d168/0xc6b31a1b598ea1c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee518 expref: 8 pid: 6701 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740410.962402:0:8506:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000508d168/0xc6b31a1b598ea1c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee518 expref: 8 pid: 6701 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740410.962426:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000508d168/0xc6b31a1b598ea1c7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee518 expref: 8 pid: 6701 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740410.962442:0:8506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790740410.962447:0:8506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790740410.962452:0:8506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000034db2d06/0xc6b31a1b598ea1dc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740410.962469:0:8506:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034db2d06/0xc6b31a1b598ea1dc lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740410.962501:0:8506:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790740410.962552:0:8506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db6dc3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec599375-3198-45fd-a23a-c5620f07177c+7:2369:x1877727133084544:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 210us (1067us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740410.962561:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 44 00010000:00010000:3.0:1790740410.962733:0:6701:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000034db2d06/0xc6b31a1b598ea1dc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740410.962743:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034db2d06/0xc6b31a1b598ea1dc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740410.963118:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000034db2d06/0xc6b31a1b598ea1dc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740410.963128:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000034db2d06/0xc6b31a1b598ea1dc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740410.963136:0:6701:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000034db2d06/0xc6b31a1b598ea1dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740410.963143:0:6701:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9fea6800 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:3.0:1790740410.963148:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000034db2d06/0xc6b31a1b598ea1dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740410.963170:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000034db2d06/0xc6b31a1b598ea1dc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740410.963183:0:6701:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000034db2d06/0xc6b31a1b598ea1dc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740410.963190:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034db2d06/0xc6b31a1b598ea1dc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740410.963250:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1b6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec599375-3198-45fd-a23a-c5620f07177c+6:2369:x1877727133084416:12345-192.168.203.58@tcp:1:lhsmtool_posix.0 Request processed in 20828us (22778us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740410.963259:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 32 00000100:00100000:3.0:1790740410.967449:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740410.967883:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133084800 00000100:00100000:2.0:1790740410.967893:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133084800 00000100:00100000:2.0:1790740410.967941:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 83 00000100:00100000:2.0:1790740410.967950:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+12:10451:x1877727133084800:12345-192.168.203.58@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1790740410.968028:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598ea1e3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.968046:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598ea1e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.968058:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598ea1e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.968277:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea1ea lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.968299:0:8666:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea1a4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee503 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.968307:0:8666:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea1ea lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.968341:0:8666:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea1a4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee503 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.968355:0:8666:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea1a4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee503 expref: 13 pid: 5842 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740410.968369:0:8666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc12ac000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8666:1877727158272640:192.168.203.58@tcp:104: 00000100:00100000:2.0:1790740410.968438:0:8666:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d9921b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790740410.972783:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740410.973158:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133084928 00000100:00100000:2.0:1790740410.973167:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133084928 00010000:00010000:2.0:1790740410.973204:0:5830:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea1a4 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee503 expref: 14 pid: 5842 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740410.973257:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 45 00000100:00100000:2.0:1790740410.973267:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec599375-3198-45fd-a23a-c5620f07177c+14:2370:x1877727133084928:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790740410.973281:0:5830:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740410.973288:0:5830:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea1a4 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee503 expref: 14 pid: 5842 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.973302:0:5830:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea1a4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee503 expref: 14 pid: 5842 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.973331:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8f0d944f6f00) 00010000:00010000:2.0:1790740410.973336:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea1ea lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.973345:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea1ea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.973353:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea1ea lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.973373:0:5830:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790740410.973430:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec599375-3198-45fd-a23a-c5620f07177c+14:2370:x1877727133084928:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 164us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740410.973438:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 45 00010000:00010000:2.0:1790740410.973483:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea1a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee503 expref: 13 pid: 5842 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740410.973495:0:8666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc12ac000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8666:1877727158272640:192.168.203.58@tcp:104: 00010000:00010000:2.0:1790740410.973513:0:8666:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea1ea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.973522:0:8666:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea1ea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.973528:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea1ea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790740410.973724:0:8666:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:2.0:1790740410.973881:0:8666:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1790740410.973925:0:8666:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:2.0:1790740410.973998:0:8666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc12ac000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8666:1877727158272768:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1790740410.974041:0:8666:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740410.974063:0:8666:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0db6ff60c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790740410.974126:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158272768 00000100:00100000:1.0:1790740410.974132:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158272768 00000100:00100000:1.0:1790740410.974167:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790740410.974174:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc12af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8666:x1877727158272768:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1790740410.974267:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc12af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8666:x1877727158272768:12345-0@lo:1000:mdt00_003.0 Request processed in 93us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740410.974283:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790740410.977526:0:8666:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1790740410.977537:0:8666:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f0d8498fb80, transno 4294967303 00000100:00100000:0.0:1790740410.977563:0:8666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc12ac000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8666:1877727158272768:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1790740410.978075:0:8666:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:0.0:1790740410.978161:0:8666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbee2c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8666:1877727158272896:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1790740410.978229:0:8666:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740410.978265:0:8666:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d9921b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790740410.983011:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158272896 00000100:00100000:2.0:1790740410.983022:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158272896 00000100:00100000:2.0:1790740410.983073:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790740410.983082:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8666:x1877727158272896:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1790740410.983337:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8666:x1877727158272896:12345-0@lo:1000:mdt00_003.0 Request processed in 256us (5108us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1790740410.983345:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790740410.983393:0:8666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbee2c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8666:1877727158272896:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1790740410.983428:0:8666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea1ea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.983439:0:8666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea1ea lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.983447:0:8666:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea1ea lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.983453:0:8666:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87595800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740410.983458:0:8666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea1ea lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.983466:0:8666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea1ea lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.983482:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8f0d944f6f00) 00010000:00010000:2.0:1790740410.983494:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790740410.983500:0:8666:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea1ea lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.983507:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea1ea lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.983544:0:8666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e800/0xc6b31a1b598ea11f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.983551:0:8666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e800/0xc6b31a1b598ea11f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.983557:0:8666:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e800/0xc6b31a1b598ea11f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.983563:0:8666:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0e800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740410.983566:0:8666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e800/0xc6b31a1b598ea11f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.983592:0:8666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e800/0xc6b31a1b598ea11f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.983612:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f0d944f6c00) 00010000:00010000:2.0:1790740410.983615:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790740410.983619:0:8666:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e800/0xc6b31a1b598ea11f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.983625:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e800/0xc6b31a1b598ea11f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.983644:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598ea1f1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.983668:0:8666:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e400/0xc6b31a1b598ea13b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4e7 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.983678:0:8666:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598ea1f1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.983709:0:8666:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e400/0xc6b31a1b598ea13b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4e7 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740410.983722:0:8666:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e400/0xc6b31a1b598ea13b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4e7 expref: 16 pid: 5844 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740410.983736:0:8666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc12ac700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8666:1877727158273024:192.168.203.58@tcp:104: 00000100:00100000:2.0:1790740410.984060:0:8666:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d8956ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1790740410.989633:0:8666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc12ac700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8666:1877727158273024:192.168.203.58@tcp:104: 00010000:00010000:0.0:1790740410.989663:0:8666:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598ea1f1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740410.990230:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740410.990293:0:8506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133085056 00000100:00100000:3.0:1790740410.990300:0:8506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133085056 00010000:00010000:3.0:1790740410.990333:0:8506:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e400/0xc6b31a1b598ea13b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4e7 expref: 17 pid: 5844 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740410.990372:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 46 00000100:00100000:3.0:1790740410.990381:0:8506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc12adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec599375-3198-45fd-a23a-c5620f07177c+17:2369:x1877727133085056:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790740410.990394:0:8506:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740410.990401:0:8506:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e400/0xc6b31a1b598ea13b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4e7 expref: 17 pid: 5844 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740410.990427:0:8506:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e400/0xc6b31a1b598ea13b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4e7 expref: 17 pid: 5844 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740410.990447:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e400/0xc6b31a1b598ea13b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee4e7 expref: 17 pid: 5844 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740410.990461:0:8506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f0d944f6c00) 00010000:00010000:3.0:1790740410.990465:0:8506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598ea1f1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740410.990475:0:8506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598ea1f1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740410.990483:0:8506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598ea1f1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740410.990511:0:8506:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790740410.990554:0:8666:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598ea1f1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.990562:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598ea1f1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740410.990627:0:8506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc12adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec599375-3198-45fd-a23a-c5620f07177c+16:2369:x1877727133085056:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 246us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740410.990642:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 46 00010000:00010000:0.0:1790740410.990769:0:8666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598ea1f1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.990777:0:8666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598ea1f1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.990784:0:8666:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598ea1f1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.990790:0:8666:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87594a00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1790740410.990794:0:8666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598ea1f1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.990802:0:8666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598ea1f1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.990811:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f0d944f6c00) 00010000:00010000:0.0:1790740410.990814:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740410.990818:0:8666:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598ea1f1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.990824:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598ea1f1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.990834:0:8666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598ea1e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.990840:0:8666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598ea1e3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.990845:0:8666:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598ea1e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.990855:0:8666:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87594400 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1790740410.990858:0:8666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598ea1e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.990863:0:8666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598ea1e3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.990871:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f0d944f6c00) 00010000:00010000:0.0:1790740410.990874:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790740410.990877:0:8666:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598ea1e3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740410.990883:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598ea1e3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740410.991127:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+15:10451:x1877727133084800:12345-192.168.203.58@tcp:57:lhsmtool_posix.0 Request processed in 23176us (23686us total) trans 4294967360 rc 0/0 00000100:00100000:0.0:1790740410.991135:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 83 00000020:00080000:0.0:1790740410.991138:0:8666:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1790740410.992339:0:11679:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790740410.992345:0:11679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790740410.992373:0:11679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1790740410.992379:0:11679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790740410.993231:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740410.993363:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133085312 00000100:00100000:1.0:1790740410.993372:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133085312 00000100:00100000:1.0:1790740410.993449:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 20 00000100:00100000:1.0:1790740410.993460:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+15:10451:x1877727133085312:12345-192.168.203.58@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1790740410.994082:0:5846:0:(mdd_object.c:4180:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1790740410.994189:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:1.0:1790740410.994245:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6a00/0xc6b31a1b598ea1f8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740410.994261:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6a00/0xc6b31a1b598ea1f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740410.994273:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6a00/0xc6b31a1b598ea1f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740410.994280:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6a00/0xc6b31a1b598ea1f8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740410.994286:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6a00/0xc6b31a1b598ea1f8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740410.994291:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6a00/0xc6b31a1b598ea1f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740410.994312:0:5846:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1790740410.994396:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+17:10451:x1877727133085312:12345-192.168.203.58@tcp:35:lhsmtool_posix.0 Request processed in 937us (1167us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1790740410.994404:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 20 00000020:00080000:1.0:1790740410.994417:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790740410.994473:0:11661:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740410.994479:0:11661:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6a00/0xc6b31a1b598ea1f8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740410.994496:0:11661:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9fea6a00 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:3.0:1790740410.994501:0:11661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6a00/0xc6b31a1b598ea1f8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740410.994509:0:11661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6a00/0xc6b31a1b598ea1f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740410.994521:0:11661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8f0d84a1e400) 00010000:00010000:3.0:1790740410.994524:0:11661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1790740410.994529:0:11661:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6a00/0xc6b31a1b598ea1f8 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740410.994534:0:11661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6a00/0xc6b31a1b598ea1f8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740410.994550:0:11661:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740410.994552:0:11661:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740410.994554:0:11661:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790740411.052327:0:11992:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790740411.052338:0:11992:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790740411.052388:0:11992:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1790740411.052397:0:11992:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790740411.201355:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740411.201428:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133085568 00000100:00100000:1.0:1790740411.201438:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133085568 00000100:00100000:1.0:1790740411.201521:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 84 00000100:00100000:1.0:1790740411.201533:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+17:10461:x1877727133085568:12345-192.168.203.58@tcp:101:lfs.0 00010000:00010000:1.0:1790740411.201556:0:5842:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740411.201620:0:5842:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6a00/0xc6b31a1b598ea1ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee51f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.201744:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6800/0xc6b31a1b598ea206 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.201759:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6800/0xc6b31a1b598ea206 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.201774:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6800/0xc6b31a1b598ea206 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790740411.201785:0:5842:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1790740411.201905:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6a00/0xc6b31a1b598ea1ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee51f expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.201921:0:5842:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6800/0xc6b31a1b598ea206 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee51f expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.201928:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f0d98dccb00) 00010000:00010000:1.0:1790740411.201931:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790740411.201934:0:5842:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9fea6800, rc 0) 00000100:00100000:1.0:1790740411.201986:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+19:10461:x1877727133085568:12345-192.168.203.58@tcp:101:lfs.0 Request processed in 455us (639us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1790740411.202007:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 84 00000100:00080000:3.0:1790740411.203099:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790740411.209504:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740411.209694:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133085696 00000100:00100000:1.0:1790740411.209705:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133085696 00000100:00100000:1.0:1790740411.209759:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 85 00000100:00100000:1.0:1790740411.209769:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+19:10461:x1877727133085696:12345-192.168.203.58@tcp:34:lfs.0 00010000:00010000:1.0:1790740411.209846:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea214 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.209864:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea214 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.209876:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea214 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.209892:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea21b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.209899:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea21b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.209906:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea21b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.210138:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea222 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.210147:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea222 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.210154:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea222 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790740411.210205:0:5844:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea222 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.210227:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea214 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.210234:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea214 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.210240:0:5844:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea214 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.210246:0:5844:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f976600 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1790740411.210250:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea214 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.210257:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea214 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.210269:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f0d98dccb00) 00010000:00010000:1.0:1790740411.210272:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740411.210277:0:5844:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea214 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.210283:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea214 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.210300:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea21b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.210306:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea21b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.210318:0:5844:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea21b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.210324:0:5844:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f977800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1790740411.210327:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea21b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.210333:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea21b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.210341:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8f0d84a1e200) 00010000:00010000:1.0:1790740411.210343:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740411.210346:0:5844:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea21b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.210351:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea21b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.210369:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea222 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.210374:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea222 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.210380:0:5844:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea222 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.210385:0:5844:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f976000 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1790740411.210388:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea222 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.210403:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea222 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.210411:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f0d84a1ef00) 00010000:00010000:1.0:1790740411.210413:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740411.210415:0:5844:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea222 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.210420:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea222 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740411.210878:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+19:10461:x1877727133085696:12345-192.168.203.58@tcp:34:lfs.0 Request processed in 1106us (1380us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740411.210888:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 85 00000100:00100000:0.0:1790740411.263036:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740411.263345:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133085952 00000100:00100000:1.0:1790740411.263357:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133085952 00000100:00100000:1.0:1790740411.263409:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 86 00000100:00100000:1.0:1790740411.263420:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc0962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+19:10464:x1877727133085952:12345-192.168.203.58@tcp:101:lfs.0 00010000:00010000:1.0:1790740411.263438:0:5842:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740411.263457:0:5842:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea229 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee526 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.263529:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea230 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.263544:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea230 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.263555:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea230 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.263605:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea237 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.263614:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea237 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.263622:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea237 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.264049:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598ea23e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.264218:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598ea23e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.264229:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598ea23e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790740411.264239:0:5842:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1790740411.264331:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea230 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.264340:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea230 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.264346:0:5842:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea230 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.264352:0:5842:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f977800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1790740411.264357:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea230 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.264600:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea230 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.264616:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f0d98dccb00) 00010000:00010000:1.0:1790740411.264619:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740411.264624:0:5842:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea230 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.264796:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea230 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.264817:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea237 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.264823:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea237 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.264828:0:5842:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea237 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.264833:0:5842:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f976600 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1790740411.264836:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea237 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.264905:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea237 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.264916:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8f0d84a1ef00) 00010000:00010000:1.0:1790740411.264918:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740411.264921:0:5842:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea237 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.264936:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea237 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.265011:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea229 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee526 expref: 22 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.265026:0:5842:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598ea23e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee526 expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.265032:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f0d84a1e200) 00010000:00010000:1.0:1790740411.265034:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790740411.265036:0:5842:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9f977000, rc 0) 00000100:00100000:1.0:1790740411.265339:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc0962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+21:10464:x1877727133085952:12345-192.168.203.58@tcp:101:lfs.0 Request processed in 1919us (2308us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1790740411.265348:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 86 00000100:00100000:0.0:1790740411.268956:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740411.269046:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133086080 00000100:00100000:2.0:1790740411.269056:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133086080 00000100:00100000:2.0:1790740411.269147:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 87 00000100:00100000:2.0:1790740411.269157:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+21:10464:x1877727133086080:12345-192.168.203.58@tcp:54:lfs.0 00010000:00010000:2.0:1790740411.269238:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea24c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.269261:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea24c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.269274:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea24c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.269312:0:8666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea24c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.269318:0:8666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea24c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.269324:0:8666:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea24c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.269330:0:8666:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87595800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740411.269335:0:8666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea24c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.269342:0:8666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea24c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.269354:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f0d84a1e200) 00010000:00010000:2.0:1790740411.269357:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790740411.269362:0:8666:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea24c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.269368:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea24c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740411.269440:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+21:10464:x1877727133086080:12345-192.168.203.58@tcp:54:lfs.0 Request processed in 284us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740411.269447:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 87 00000100:00100000:3.0:1790740411.272720:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740411.272915:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133086336 00000100:00100000:2.0:1790740411.272925:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133086336 00000100:00100000:2.0:1790740411.273009:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 21 00000100:00100000:2.0:1790740411.273030:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0da203b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec599375-3198-45fd-a23a-c5620f07177c+21:10464:x1877727133086336:12345-192.168.203.58@tcp:35:lfs.0 00000100:00100000:2.0:1790740411.273545:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0da203b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec599375-3198-45fd-a23a-c5620f07177c+22:10464:x1877727133086336:12345-192.168.203.58@tcp:35:lfs.0 Request processed in 513us (972us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1790740411.273554:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 21 00000100:00100000:0.0:1790740411.315020:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740411.315185:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133086592 00000100:00100000:2.0:1790740411.315195:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133086592 00000100:00100000:2.0:1790740411.315285:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 88 00000100:00100000:2.0:1790740411.315295:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1697100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+22:9993:x1877727133086592:12345-192.168.203.58@tcp:101:bash.0 00010000:00010000:2.0:1790740411.315318:0:5843:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740411.315338:0:5843:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea253 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee52d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.315438:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595600/0xc6b31a1b598ea25a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.315451:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598ea23e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee526 expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.315473:0:5843:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595600/0xc6b31a1b598ea25a lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.315507:0:5843:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598ea23e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee526 expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.315520:0:5843:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598ea23e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee526 expref: 23 pid: 5842 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740411.315533:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc12aea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1877727158273152:192.168.203.58@tcp:104: 00000100:00100000:2.0:1790740411.315669:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d8956f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790740411.321019:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740411.321270:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133086720 00000100:00100000:3.0:1790740411.321280:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133086720 00010000:00010000:3.0:1790740411.321319:0:5830:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598ea23e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee526 expref: 24 pid: 5842 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740411.321359:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 47 00000100:00100000:3.0:1790740411.321369:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1697b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec599375-3198-45fd-a23a-c5620f07177c+24:2369:x1877727133086720:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790740411.321385:0:5830:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740411.321405:0:5830:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598ea23e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee526 expref: 24 pid: 5842 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740411.321418:0:5830:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598ea23e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee526 expref: 24 pid: 5842 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740411.321441:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f0d84a1e200) 00010000:00010000:3.0:1790740411.321446:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595600/0xc6b31a1b598ea25a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.321629:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598ea23e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee526 expref: 24 pid: 5842 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740411.321651:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc12aea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1877727158273152:192.168.203.58@tcp:104: 00010000:00010000:3.0:1790740411.321719:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595600/0xc6b31a1b598ea25a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740411.321728:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595600/0xc6b31a1b598ea25a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.326272:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595600/0xc6b31a1b598ea25a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740411.327632:0:5830:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790740411.327742:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595600/0xc6b31a1b598ea25a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.327754:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595600/0xc6b31a1b598ea25a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740411.327777:0:5843:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1790740411.327952:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea253 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee52d expref: 25 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.327972:0:5843:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595600/0xc6b31a1b598ea25a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee52d expref: 24 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.327981:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f0d84a1e200) 00010000:00010000:2.0:1790740411.327983:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790740411.327987:0:5843:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d87595600, rc 0) 00000100:00100000:2.0:1790740411.328656:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1697100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+24:9993:x1877727133086592:12345-192.168.203.58@tcp:101:bash.0 Request processed in 12758us (13039us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1790740411.328665:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 88 00000100:00100000:1.0:1790740411.331867:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1697b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec599375-3198-45fd-a23a-c5620f07177c+23:2369:x1877727133086720:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 10487us (10844us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740411.331883:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 47 00000100:00100000:0.0:1790740411.343331:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740411.343439:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133086976 00000100:00100000:1.0:1790740411.343450:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133086976 00000100:00100000:1.0:1790740411.343555:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 89 00000100:00100000:1.0:1790740411.343565:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1696300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+23:9993:x1877727133086976:12345-192.168.203.58@tcp:36:bash.0 00010000:00010000:1.0:1790740411.343845:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea268 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.343863:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea268 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.343882:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea268 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790740411.343939:0:5844:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:1.0:1790740411.343964:0:5844:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000fcd36606 reply state 000000005c67916d transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea268 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740411.343974:0:5844:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1790740411.344063:0:5844:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:1.0:1790740411.344163:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1696300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+27:9993:x1877727133086976:12345-192.168.203.58@tcp:36:bash.0 Request processed in 598us (839us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1790740411.344171:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 89 00000020:00080000:1.0:1790740411.344176:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1790740411.348256:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740411.351781:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133087104 00000100:00100000:1.0:1790740411.351795:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133087104 00000100:00100000:1.0:1790740411.351862:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 90 00000100:00100000:1.0:1790740411.351872:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+27:9993:x1877727133087104:12345-192.168.203.58@tcp:101:bash.0 00010000:00010000:1.0:1790740411.351896:0:5844:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740411.351918:0:5844:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea26f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee534 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.351983:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea26f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee534 expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.351997:0:5844:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea26f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee534 expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.352015:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f0d84a1e200) 00010000:00010000:1.0:1790740411.352030:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790740411.352034:0:5844:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9f976600, rc 0) 00000100:00100000:1.0:1790740411.352115:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+28:9993:x1877727133087104:12345-192.168.203.58@tcp:101:bash.0 Request processed in 244us (3869us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740411.352123:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 90 00010000:00010000:0.0:1790740411.354413:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea268 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740411.354429:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea268 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740411.354437:0:3290:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea268 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740411.354443:0:3290:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f976000 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1790740411.354448:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea268 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740411.354555:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea268 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740411.354589:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f0d84a1e200) 00010000:00010000:0.0:1790740411.354593:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740411.354598:0:3290:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea268 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740411.354604:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea268 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740411.355259:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740411.355341:0:8460:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133087232 00000100:00100000:2.0:1790740411.355365:0:8460:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133087232 00000100:00100000:2.0:1790740411.355422:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 33 00000100:00100000:2.0:1790740411.355433:0:8460:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1694380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec599375-3198-45fd-a23a-c5620f07177c+6:9993:x1877727133087232:12345-192.168.203.58@tcp:101:bash.0 00010000:00010000:2.0:1790740411.355451:0:8460:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740411.355481:0:8460:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d19dd53/0xc6b31a1b598ea276 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee53b expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790740411.355518:0:8460:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6abc87b9, atime: 0x6abc87b8, ctime: 0x6abc87b9, blocks: 0xb 00010000:00010000:2.0:1790740411.355538:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=327s v=(0 0) 00010000:00010000:2.0:1790740411.355543:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790740411.355551:0:8460:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d19dd53/0xc6b31a1b598ea276 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee53b expref: 7 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.355569:0:8460:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002d19dd53/0xc6b31a1b598ea276 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee53b expref: 7 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.355603:0:8460:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d87595800, rc 0) 00000100:00100000:2.0:1790740411.355660:0:8460:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1694380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec599375-3198-45fd-a23a-c5620f07177c+7:9993:x1877727133087232:12345-192.168.203.58@tcp:101:bash.0 Request processed in 229us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740411.355667:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 33 00000100:00100000:1.0:1790740411.360479:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740411.360558:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133087360 00000100:00100000:3.0:1790740411.360569:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133087360 00002000:00010000:3.0:1790740411.360641:0:6705:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:3.0:1790740411.360646:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f0db6dc0700 with x1877727133087360 ext(0->18446744073709551615) 00002000:00010000:3.0:1790740411.360656:0:6705:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f0db6dc0700. 00000100:00100000:3.0:1790740411.360679:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 1 00000100:00100000:3.0:1790740411.360687:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db6dc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ec599375-3198-45fd-a23a-c5620f07177c+7:2369:x1877727133087360:12345-192.168.203.58@tcp:10:bash.0 00002000:00010000:3.0:1790740411.360956:0:6705:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1790740411.360960:0:6705:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1790740409 -> 1790740411 00002000:00010000:3.0:1790740411.360963:0:6705:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1790740408 -> 1790740408 00002000:00010000:3.0:1790740411.360965:0:6705:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1790740409 -> 1790740411 00002000:00010000:3.0:1790740411.360979:0:6705:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1790740411.361229:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db6dc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ec599375-3198-45fd-a23a-c5620f07177c+8:2369:x1877727133087360:12345-192.168.203.58@tcp:10:bash.0 Request processed in 541us (756us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1790740411.361239:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 1 00002000:00010000:3.0:1790740411.361244:0:6705:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:3.0:1790740411.361246:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f0db6dc0700 with x1877727133087360 ext(0->18446744073709551615) 00002000:00010000:3.0:1790740411.361251:0:6705:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f0db6dc0700. 00000100:00100000:3.0:1790740411.430798:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740411.430856:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133087488 00000100:00100000:2.0:1790740411.430866:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133087488 00000100:00100000:2.0:1790740411.430996:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 91 00000100:00100000:2.0:1790740411.431007:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+27:10478:x1877727133087488:12345-192.168.203.58@tcp:34:lfs.0 00010000:00010000:2.0:1790740411.431229:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea27d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.431264:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea27d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.431399:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea27d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.431419:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594600/0xc6b31a1b598ea284 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.431427:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594600/0xc6b31a1b598ea284 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.431435:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594600/0xc6b31a1b598ea284 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.431871:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598ea28b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.431882:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598ea28b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.431890:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598ea28b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790740411.431931:0:8666:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598ea28b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.431943:0:8666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea27d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.431950:0:8666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea27d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.431967:0:8666:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea27d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.431973:0:8666:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87594800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740411.431977:0:8666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea27d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.431985:0:8666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea27d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.431996:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f0d98dccb00) 00010000:00010000:2.0:1790740411.431999:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740411.432004:0:8666:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea27d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.432010:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea27d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.432022:0:8666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594600/0xc6b31a1b598ea284 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.432028:0:8666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594600/0xc6b31a1b598ea284 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.432035:0:8666:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594600/0xc6b31a1b598ea284 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.432040:0:8666:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87594600 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740411.432043:0:8666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594600/0xc6b31a1b598ea284 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.432530:0:8666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594600/0xc6b31a1b598ea284 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.432540:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8f0d98dcc300) 00010000:00010000:2.0:1790740411.432542:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740411.432546:0:8666:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594600/0xc6b31a1b598ea284 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.432551:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594600/0xc6b31a1b598ea284 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.432566:0:8666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598ea28b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.432665:0:8666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598ea28b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.432671:0:8666:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598ea28b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.432676:0:8666:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87595400 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740411.432679:0:8666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598ea28b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.432685:0:8666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598ea28b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.432691:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f0d84a1e200) 00010000:00010000:2.0:1790740411.432694:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740411.432697:0:8666:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598ea28b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.432713:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598ea28b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740411.432816:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+27:10478:x1877727133087488:12345-192.168.203.58@tcp:34:lfs.0 Request processed in 1807us (2020us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740411.432824:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 91 00000100:00100000:0.0:1790740411.478186:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740411.478346:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133087744 00000100:00100000:2.0:1790740411.478355:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133087744 00000100:00100000:2.0:1790740411.478415:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 92 00000100:00100000:2.0:1790740411.478426:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1694e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+27:10481:x1877727133087744:12345-192.168.203.58@tcp:101:lfs.0 00010000:00010000:2.0:1790740411.478446:0:5842:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740411.478477:0:5842:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598ea292 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee542 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.478550:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594600/0xc6b31a1b598ea299 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.478565:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594600/0xc6b31a1b598ea299 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.478615:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594600/0xc6b31a1b598ea299 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.478630:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea2a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.478648:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea2a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.478672:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea2a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.478923:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea2a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.478933:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea2a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.478941:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea2a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740411.478950:0:5842:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1790740411.479038:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594600/0xc6b31a1b598ea299 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.479046:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594600/0xc6b31a1b598ea299 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.479053:0:5842:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594600/0xc6b31a1b598ea299 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.479060:0:5842:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87594600 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740411.479064:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594600/0xc6b31a1b598ea299 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.479081:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594600/0xc6b31a1b598ea299 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.479094:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f0d98dccb00) 00010000:00010000:2.0:1790740411.479097:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740411.479109:0:5842:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594600/0xc6b31a1b598ea299 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.479116:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594600/0xc6b31a1b598ea299 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.479129:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea2a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.479135:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea2a0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.479142:0:5842:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea2a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.479147:0:5842:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87594800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740411.479149:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea2a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.479155:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea2a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.479163:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8f0d98dcc300) 00010000:00010000:2.0:1790740411.479166:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740411.479168:0:5842:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea2a0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.479174:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea2a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.479223:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598ea292 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee542 expref: 30 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.479255:0:5842:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea2a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee542 expref: 29 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.479261:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f0d84a1e200) 00010000:00010000:2.0:1790740411.479263:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1790740411.479265:0:5842:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d87594200, rc 0) 00000100:00100000:2.0:1790740411.479327:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1694e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+29:10481:x1877727133087744:12345-192.168.203.58@tcp:101:lfs.0 Request processed in 902us (1148us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1790740411.479335:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 92 00000100:00100000:1.0:1790740411.484558:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740411.484913:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133087872 00000100:00100000:3.0:1790740411.484988:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133087872 00000100:00100000:2.0:1790740411.485226:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 93 00000100:00100000:2.0:1790740411.485239:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db6dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+29:10481:x1877727133087872:12345-192.168.203.58@tcp:54:lfs.0 00010000:00010000:2.0:1790740411.485308:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598ea2b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.485325:0:8666:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595600/0xc6b31a1b598ea25a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee52d expref: 29 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.485336:0:8666:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598ea2b5 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.485373:0:8666:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595600/0xc6b31a1b598ea25a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee52d expref: 29 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.485386:0:8666:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595600/0xc6b31a1b598ea25a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee52d expref: 29 pid: 5843 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740411.485418:0:8666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc12aea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8666:1877727158273280:192.168.203.58@tcp:104: 00000100:00100000:2.0:1790740411.485616:0:8666:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d8956f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790740411.490151:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740411.490481:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133088128 00000100:00100000:0.0:1790740411.490490:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133088128 00000100:00100000:0.0:1790740411.490549:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 22 00000100:00100000:2.0:1790740411.490552:0:8666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc12aea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8666:1877727158273280:192.168.203.58@tcp:104: 00000100:00100000:0.0:1790740411.490558:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db6dc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+30:5608:x1877727133088128:12345-192.168.203.58@tcp:35:ldlm_bl.0 00010000:00010000:2.0:1790740411.490599:0:8666:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598ea2b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740411.490889:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db6dc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+31:5608:x1877727133088128:12345-192.168.203.58@tcp:35:ldlm_bl.0 Request processed in 330us (749us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1790740411.490909:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 22 00000100:00100000:0.0:1790740411.493270:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740411.493513:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133088256 00000100:00100000:1.0:1790740411.493523:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133088256 00010000:00010000:1.0:1790740411.493564:0:5828:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595600/0xc6b31a1b598ea25a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee52d expref: 31 pid: 5843 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740411.493676:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 48 00000100:00100000:1.0:1790740411.493686:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1695880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec599375-3198-45fd-a23a-c5620f07177c+31:2370:x1877727133088256:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790740411.493701:0:5828:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740411.493709:0:5828:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595600/0xc6b31a1b598ea25a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee52d expref: 31 pid: 5843 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.493723:0:5828:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595600/0xc6b31a1b598ea25a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee52d expref: 31 pid: 5843 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.493754:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595600/0xc6b31a1b598ea25a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee52d expref: 31 pid: 5843 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.493770:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f0d84a1e200) 00010000:00010000:1.0:1790740411.493776:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598ea2b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.493800:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598ea2b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.493807:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598ea2b5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.493846:0:5828:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740411.493899:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1695880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec599375-3198-45fd-a23a-c5620f07177c+30:2370:x1877727133088256:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 213us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740411.493907:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 48 00010000:00010000:2.0:1790740411.493968:0:8666:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598ea2b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.493977:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598ea2b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.494180:0:8666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598ea2b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.494188:0:8666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598ea2b5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.494195:0:8666:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598ea2b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.494201:0:8666:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87595c00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740411.494220:0:8666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598ea2b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.494229:0:8666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598ea2b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.494239:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f0d84a1e200) 00010000:00010000:2.0:1790740411.494249:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790740411.494255:0:8666:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598ea2b5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.494261:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598ea2b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740411.494328:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db6dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+29:10481:x1877727133087872:12345-192.168.203.58@tcp:54:lfs.0 Request processed in 9093us (9779us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740411.494338:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 93 00000100:00100000:0.0:1790740411.497732:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740411.497851:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133088512 00000100:00100000:1.0:1790740411.497876:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133088512 00000100:00100000:1.0:1790740411.497931:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 23 00000100:00100000:1.0:1790740411.497941:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1694a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+29:10481:x1877727133088512:12345-192.168.203.58@tcp:35:lfs.0 00000100:00100000:1.0:1790740411.498182:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1694a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+30:10481:x1877727133088512:12345-192.168.203.58@tcp:35:lfs.0 Request processed in 242us (456us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1790740411.498190:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 23 00000100:00100000:1.0:1790740411.587821:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740411.587924:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133088768 00000100:00100000:2.0:1790740411.587934:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133088768 00000100:00100000:2.0:1790740411.587995:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 94 00000100:00100000:2.0:1790740411.588007:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db6dc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+30:10492:x1877727133088768:12345-192.168.203.58@tcp:101:cat.0 00010000:00010000:2.0:1790740411.588031:0:5842:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740411.588051:0:5842:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598ea2bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee549 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.588138:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598ea2c3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.588153:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598ea2c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.588164:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598ea2c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.588177:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea2ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.588183:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea2ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.588199:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea2ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.588448:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594600/0xc6b31a1b598ea2d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.588457:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594600/0xc6b31a1b598ea2d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.588465:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594600/0xc6b31a1b598ea2d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740411.588474:0:5842:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:2.0:1790740411.588560:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598ea2c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.588568:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598ea2c3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.588617:0:5842:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598ea2c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.588623:0:5842:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87595400 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740411.588627:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598ea2c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.588635:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598ea2c3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.588647:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f0d98dccb00) 00010000:00010000:2.0:1790740411.588651:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740411.588662:0:5842:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598ea2c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.588668:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598ea2c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.588681:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea2ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.588687:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea2ca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.588693:0:5842:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea2ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.588698:0:5842:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87594800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740411.588701:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea2ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.588706:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea2ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.588713:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8f0d98dcc300) 00010000:00010000:2.0:1790740411.588716:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740411.588718:0:5842:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea2ca lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.588724:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea2ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.588763:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598ea2bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee549 expref: 33 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.588790:0:5842:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594600/0xc6b31a1b598ea2d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee549 expref: 32 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.588797:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f0d84a1e200) 00010000:00010000:2.0:1790740411.588799:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790740411.588802:0:5842:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d87594600, rc 0) 00000100:00100000:2.0:1790740411.588855:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db6dc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+32:10492:x1877727133088768:12345-192.168.203.58@tcp:101:cat.0 Request processed in 850us (1043us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1790740411.588862:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 94 00000100:00100000:0.0:1790740411.595168:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740411.595339:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133089024 00000100:00100000:1.0:1790740411.595354:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133089024 00000100:00100000:1.0:1790740411.595410:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 24 00000100:00100000:1.0:1790740411.595419:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1695180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+32:10492:x1877727133089024:12345-192.168.203.58@tcp:35:cat.0 00000100:00100000:1.0:1790740411.595693:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1695180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+33:10492:x1877727133089024:12345-192.168.203.58@tcp:35:cat.0 Request processed in 273us (533us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1790740411.595701:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 24 00000100:00100000:0.0:1790740411.641277:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740411.641378:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133089280 00000100:00100000:3.0:1790740411.641388:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133089280 00000100:00100000:3.0:1790740411.641449:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 95 00000100:00100000:3.0:1790740411.641459:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1694000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+33:10493:x1877727133089280:12345-192.168.203.58@tcp:36:rm.0 00010000:00010000:3.0:1790740411.641521:0:5844:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1790740411.641547:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594600/0xc6b31a1b598ea2d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee549 expref: 33 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740411.641609:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea2a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee542 expref: 32 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740411.641623:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea26f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee534 expref: 31 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740411.641640:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f0d84a1e200) 00010000:00010000:3.0:1790740411.641652:0:5844:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790740411.641671:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fa00/0xc6b31a1b598ea2df lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740411.641698:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fa00/0xc6b31a1b598ea2df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740411.641709:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fa00/0xc6b31a1b598ea2df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740411.641725:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598ea2e6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740411.641732:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598ea2e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740411.641739:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598ea2e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740411.641979:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f800/0xc6b31a1b598ea2ed lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740411.641988:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f800/0xc6b31a1b598ea2ed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740411.641995:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f800/0xc6b31a1b598ea2ed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790740411.642543:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00010000:00010000:3.0:1790740411.642660:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598ea2f4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740411.642670:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598ea2f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740411.642677:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598ea2f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740411.642691:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598ea2f4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740411.642698:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598ea2f4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740411.642705:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598ea2f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740411.642734:0:5844:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790740411.642756:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f800/0xc6b31a1b598ea2ed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740411.642762:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f800/0xc6b31a1b598ea2ed lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740411.642769:0:5844:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f800/0xc6b31a1b598ea2ed lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740411.642774:0:5844:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0f800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1790740411.642778:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f800/0xc6b31a1b598ea2ed lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740411.642786:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f800/0xc6b31a1b598ea2ed lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740411.642796:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f0d944f6a00) 00010000:00010000:3.0:1790740411.642799:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1790740411.642803:0:5844:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f800/0xc6b31a1b598ea2ed lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740411.642819:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f800/0xc6b31a1b598ea2ed lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740411.642835:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fa00/0xc6b31a1b598ea2df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740411.642841:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fa00/0xc6b31a1b598ea2df lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740411.642847:0:5844:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fa00/0xc6b31a1b598ea2df lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740411.642853:0:5844:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0fa00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1790740411.642856:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fa00/0xc6b31a1b598ea2df lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740411.642862:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fa00/0xc6b31a1b598ea2df lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740411.642872:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f0d98dccb00) 00010000:00010000:3.0:1790740411.642874:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740411.642883:0:5844:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fa00/0xc6b31a1b598ea2df lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740411.642888:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fa00/0xc6b31a1b598ea2df lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790740411.642896:0:5844:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000002850f5d9 reply state 00000000511ef7bf transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598ea2e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740411.642904:0:5844:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790740411.642987:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1694000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+32:10493:x1877727133089280:12345-192.168.203.58@tcp:36:rm.0 Request processed in 1526us (1718us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1790740411.642996:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 95 00010000:00010000:1.0:1790740411.642999:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790740411.643013:0:5832:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598ea2f4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.643022:0:5832:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0f000 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:1.0:1790740411.643026:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598ea2f4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.643034:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598ea2f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.643045:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f0d944f6a00) 00010000:00010000:1.0:1790740411.643048:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1790740411.643052:0:5832:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598ea2f4 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.643058:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598ea2f4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.643074:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740411.643076:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740411.643078:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740411.644377:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598ea2e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.644391:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598ea2e6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.644398:0:3289:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598ea2e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.644404:0:3289:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0e600 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740411.644408:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598ea2e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.644414:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598ea2e6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.644426:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8f0d944f6100) 00010000:00010000:2.0:1790740411.644429:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740411.644433:0:3289:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598ea2e6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.644450:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598ea2e6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740411.697233:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc12af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158273792:0@lo:400:kworker.0 00000100:00100000:1.0:1790740411.697301:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc12ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1877727158273664:0@lo:400:kworker.0 00000100:00100000:2.0:1790740411.697319:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740411.697385:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc12aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3305:1877727158273408:0@lo:400:kworker.0 00000100:00100000:3.0:1790740411.697504:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc12adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877727158273536:0@lo:400:kworker.0 00000100:00100000:1.0:1790740411.698265:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740411.698527:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740411.698583:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc12aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1877727158273920:0@lo:400:kworker.0 00000100:00100000:0.0:1790740411.698627:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740411.698664:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158273664 00000100:00100000:0.0:1790740411.698672:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158273664 00000100:00100000:0.0:1790740411.698721:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158273920 00000100:00100000:0.0:1790740411.698725:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158273920 00000100:00100000:0.0:1790740411.698764:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1790740411.698776:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db6dc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1877727158273664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740411.698821:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158273408 00000100:00100000:1.0:1790740411.698827:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158273408 00000100:00100000:0.0:1790740411.698850:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db6dc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1877727158273664:12345-0@lo:400:kworker.0 Request processed in 76us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740411.698860:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1790740411.698864:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1790740411.698875:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83fedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3305:x1877727158273408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740411.698884:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1790740411.698894:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1697800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877727158273920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740411.698927:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83fedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3305:x1877727158273408:12345-0@lo:400:kworker.0 Request processed in 54us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740411.698935:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1790740411.698940:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1697800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877727158273920:12345-0@lo:400:kworker.0 Request processed in 47us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740411.698948:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:0.0:1790740411.698970:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1790740411.698996:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740411.699028:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc12ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1877727158273664:0@lo:400:kworker.0 00000100:00100000:1.0:1790740411.699079:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc12aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3305:1877727158273408:0@lo:400:kworker.0 00000100:00100000:1.0:1790740411.699093:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc12aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1877727158273920:0@lo:400:kworker.0 00000100:00100000:1.0:1790740411.699147:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158273792 00000100:00100000:1.0:1790740411.699151:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158273792 00000100:00100000:1.0:1790740411.699183:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790740411.699191:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc12af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3304:x1877727158273792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740411.699239:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc12af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3304:x1877727158273792:12345-0@lo:400:kworker.0 Request processed in 49us (1933us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740411.699245:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1790740411.699272:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790740411.703317:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc12af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158273792:0@lo:400:kworker.0 00000100:00100000:3.0:1790740411.706682:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740411.706847:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158273536 00000100:00100000:0.0:1790740411.706858:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158273536 00000100:00100000:0.0:1790740411.706920:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1790740411.706931:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877727158273536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740411.707008:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877727158273536:12345-0@lo:400:kworker.0 Request processed in 79us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740411.707015:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1790740411.707187:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc12adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877727158273536:0@lo:400:kworker.0 00000100:00100000:3.0:1790740411.707201:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc12ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158274048:0@lo:400:kworker.0 00000100:00100000:3.0:1790740411.707249:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740411.707703:0:8460:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158274048 00000100:00100000:2.0:1790740411.707709:0:8460:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158274048 00000100:00100000:2.0:1790740411.707741:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1790740411.707749:0:8460:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1e56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1877727158274048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740411.707956:0:8460:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1e56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1877727158274048:12345-0@lo:400:kworker.0 Request processed in 208us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740411.707963:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1790740411.708230:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc12ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158274048:0@lo:400:kworker.0 00000100:00100000:0.0:1790740411.713845:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740411.714457:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133089536 00000100:00100000:2.0:1790740411.714467:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133089536 00000100:00100000:2.0:1790740411.714529:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 96 00000100:00100000:2.0:1790740411.714539:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1694700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+31:10499:x1877727133089536:12345-192.168.203.58@tcp:101:bash.0 00010000:00010000:2.0:1790740411.714564:0:8666:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740411.714624:0:8666:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598ea2fb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee550 expref: -99 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.714786:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea302 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.714803:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea302 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.714825:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea302 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.714841:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598ea309 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.714849:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598ea309 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.714856:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598ea309 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790740411.715856:0:8666:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1790740411.716035:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea310 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.716049:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea310 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.716058:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea310 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.716090:0:8666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea302 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.716097:0:8666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea302 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.716103:0:8666:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea302 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.716275:0:8666:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87594800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740411.716288:0:8666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea302 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.716296:0:8666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea302 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.716308:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f0d98dccb00) 00010000:00010000:2.0:1790740411.716312:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740411.716317:0:8666:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea302 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.716323:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea302 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790740411.716412:0:8666:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000002dca3e58 reply state 000000002f91c14b transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598ea309 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740411.716422:0:8666:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1790740411.716456:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598ea2fb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee550 expref: 34 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.716472:0:8666:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea310 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee550 expref: 33 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.716480:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f0d98dccf00) 00010000:00010000:2.0:1790740411.716482:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790740411.716484:0:8666:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d87594e00, rc 0) 00000100:00100000:2.0:1790740411.716551:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1694700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+34:10499:x1877727133089536:12345-192.168.203.58@tcp:101:bash.0 Request processed in 2013us (2714us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1790740411.716560:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 96 00010000:00010000:3.0:1790740411.719127:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598ea309 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740411.719145:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598ea309 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740411.719153:0:3290:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598ea309 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740411.719159:0:3290:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87595400 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1790740411.719164:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598ea309 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740411.719172:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598ea309 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740411.719186:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8f0d98dcc300) 00010000:00010000:3.0:1790740411.719190:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740411.719194:0:3290:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598ea309 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740411.719229:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598ea309 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740411.730234:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740411.730558:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133089664 00000100:00100000:1.0:1790740411.730568:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133089664 00000100:00100000:1.0:1790740411.730664:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 34 00000100:00100000:1.0:1790740411.730674:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1695f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec599375-3198-45fd-a23a-c5620f07177c+7:2369:x1877727133089664:12345-192.168.203.58@tcp:101:bash.0 00010000:00010000:1.0:1790740411.730691:0:6699:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740411.730714:0:6699:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000333f69b5/0xc6b31a1b598ea31e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee557 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790740411.730753:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790740411.730772:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=327s v=(0 0) 00010000:00010000:1.0:1790740411.730786:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790740411.730796:0:6699:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000333f69b5/0xc6b31a1b598ea31e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee557 expref: 8 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.730813:0:6699:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000333f69b5/0xc6b31a1b598ea31e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee557 expref: 8 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.730847:0:6699:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9f976600, rc 0) 00000100:00100000:1.0:1790740411.730913:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1695f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec599375-3198-45fd-a23a-c5620f07177c+8:2369:x1877727133089664:12345-192.168.203.58@tcp:101:bash.0 Request processed in 240us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740411.730919:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 34 00000100:00080000:0.0:1790740411.732966:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790740411.741087:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740411.743168:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133089792 00000100:00100000:2.0:1790740411.743183:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133089792 00000100:00100000:2.0:1790740411.743273:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 35 00000100:00100000:2.0:1790740411.743285:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1696a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec599375-3198-45fd-a23a-c5620f07177c+8:10499:x1877727133089792:12345-192.168.203.58@tcp:101:bash.0 00010000:00010000:2.0:1790740411.743310:0:6700:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740411.743331:0:6700:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000425923b/0xc6b31a1b598ea325 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee55e expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.743372:0:6700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000333f69b5/0xc6b31a1b598ea31e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee557 expref: 9 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.743381:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790740411.743385:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790740411.743390:0:6700:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000425923b/0xc6b31a1b598ea325 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee55e expref: 9 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.743428:0:6700:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000333f69b5/0xc6b31a1b598ea31e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee557 expref: 9 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.743441:0:6700:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000333f69b5/0xc6b31a1b598ea31e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee557 expref: 9 pid: 6699 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740411.743455:0:6700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc12af100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6700:1877727158274176:192.168.203.58@tcp:104: 00000100:00100000:2.0:1790740411.743544:0:6700:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d8956f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790740411.750518:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740411.750873:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133089920 00000100:00100000:3.0:1790740411.750883:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133089920 00010000:00010000:3.0:1790740411.750924:0:5829:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000333f69b5/0xc6b31a1b598ea31e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee557 expref: 10 pid: 6699 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740411.750968:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 49 00000100:00100000:3.0:1790740411.750977:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d87403c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec599375-3198-45fd-a23a-c5620f07177c+10:2369:x1877727133089920:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790740411.750992:0:5829:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740411.751013:0:5829:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000333f69b5/0xc6b31a1b598ea31e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee557 expref: 10 pid: 6699 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740411.751028:0:5829:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000333f69b5/0xc6b31a1b598ea31e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee557 expref: 10 pid: 6699 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740411.751055:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790740411.751059:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790740411.751067:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000425923b/0xc6b31a1b598ea325 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee55e expref: 10 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740411.751077:0:5829:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000425923b/0xc6b31a1b598ea325 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee55e expref: 10 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740411.751117:0:5829:0:(ldlm_lockd.c:1085:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000425923b/0xc6b31a1b598ea325 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee55e expref: 10 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740411.751145:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbee6e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5829:1877727158274304:192.168.203.58@tcp:105: 00000100:00100000:3.0:1790740411.751244:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0db6f3b000 going to sleep for 11 seconds 00010000:00010000:0.0:1790740411.753685:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000333f69b5/0xc6b31a1b598ea31e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee557 expref: 10 pid: 6699 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740411.753715:0:6700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc12af100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6700:1877727158274176:192.168.203.58@tcp:104: 00010000:00010000:0.0:1790740411.753749:0:6700:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000425923b/0xc6b31a1b598ea325 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee55e expref: 9 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740411.753763:0:6700:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d87594800, rc 0) 00000100:00100000:0.0:1790740411.753825:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1696a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec599375-3198-45fd-a23a-c5620f07177c+9:10499:x1877727133089792:12345-192.168.203.58@tcp:101:bash.0 Request processed in 10541us (12750us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740411.753834:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 35 00000100:00100000:0.0:1790740411.758033:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740411.758123:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133090176 00000100:00100000:1.0:1790740411.758133:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133090176 00000100:00100000:1.0:1790740411.758194:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 25 00000100:00100000:3.0:1790740411.758200:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbee6e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5829:1877727158274304:192.168.203.58@tcp:105: 00000100:00100000:1.0:1790740411.758215:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1695c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+33:10499:x1877727133090176:12345-192.168.203.58@tcp:35:bash.0 00010000:00010000:3.0:1790740411.758236:0:5829:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790740411.758296:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d87403c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec599375-3198-45fd-a23a-c5620f07177c+8:2369:x1877727133089920:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 7319us (7787us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740411.758305:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 49 00000100:00100000:1.0:1790740411.758526:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1695c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+34:10499:x1877727133090176:12345-192.168.203.58@tcp:35:bash.0 Request processed in 323us (502us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1790740411.758533:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 25 00000100:00100000:2.0:1790740411.961010:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740411.973445:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133090304 00000100:00100000:0.0:1790740411.973460:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133090304 00000100:00100000:0.0:1790740411.973610:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 97 00000100:00100000:0.0:1790740411.973634:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc12af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+34:10515:x1877727133090304:12345-192.168.203.58@tcp:101:lfs.0 00010000:00010000:0.0:1790740411.973669:0:5843:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740411.973691:0:5843:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598ea32c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee565 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740411.974158:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea333 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740411.974174:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea333 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740411.974185:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea333 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790740411.974230:0:5843:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1790740411.974233:0:5843:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790740411.974250:0:5843:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea333 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740411.974275:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598ea32c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee565 expref: 36 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740411.974294:0:5843:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea333 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee565 expref: 35 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740411.974303:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f0d98dccb00) 00010000:00010000:0.0:1790740411.974306:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790740411.974309:0:5843:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0dc132f800, rc 0) 00000100:00100000:0.0:1790740411.974383:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc12af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+35:10515:x1877727133090304:12345-192.168.203.58@tcp:101:lfs.0 Request processed in 751us (13381us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740411.974400:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 97 00000100:00100000:0.0:1790740411.979960:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740411.980279:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133090560 00000100:00100000:1.0:1790740411.980290:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133090560 00000100:00100000:1.0:1790740411.980348:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 98 00000100:00100000:1.0:1790740411.980357:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1695500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+35:10515:x1877727133090560:12345-192.168.203.58@tcp:101:lfs.0 00010000:00010000:1.0:1790740411.980375:0:5844:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740411.980394:0:5844:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598ea33a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee56c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.980500:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea341 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.980515:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea341 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.980527:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea341 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790740411.980550:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1790740411.980703:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598ea33a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee56c expref: 38 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.980727:0:5844:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea341 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee56c expref: 37 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740411.980736:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f0d98dccf00) 00010000:00010000:1.0:1790740411.980739:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790740411.980742:0:5844:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9f977800, rc 0) 00000100:00100000:1.0:1790740411.980805:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1695500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+37:10515:x1877727133090560:12345-192.168.203.58@tcp:101:lfs.0 Request processed in 449us (854us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1790740411.980812:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 98 00000100:00100000:3.0:1790740411.984525:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740411.987345:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133090816 00000100:00100000:0.0:1790740411.987362:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133090816 00000100:00100000:2.0:1790740411.987409:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740411.987467:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 99 00000100:00100000:2.0:1790740411.987699:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+37:10515:x1877727133090816:12345-192.168.203.58@tcp:101:lfs.0 00010000:00010000:2.0:1790740411.987724:0:5843:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740411.987744:0:5843:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598ea34f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee573 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.987849:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598ea356 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.987864:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598ea356 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.987876:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598ea356 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740411.987887:0:5843:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1790740411.988003:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598ea34f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee573 expref: 40 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.988021:0:5843:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598ea356 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee573 expref: 39 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740411.988030:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f0d98dccf00) 00010000:00010000:2.0:1790740411.988033:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1790740411.988036:0:5843:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d87595e00, rc 0) 00000100:00100000:2.0:1790740411.988365:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+39:10515:x1877727133090816:12345-192.168.203.58@tcp:101:lfs.0 Request processed in 888us (3848us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1790740411.988373:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 99 00000100:00100000:3.0:1790740411.988456:0:8506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133090944 00000100:00100000:3.0:1790740411.988463:0:8506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133090944 00000100:00100000:3.0:1790740411.988518:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 6 00000100:00100000:3.0:1790740411.988527:0:8506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc12afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec599375-3198-45fd-a23a-c5620f07177c+39:2369:x1877727133090944:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790740411.988537:0:8506:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740411.988550:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea341 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee56c expref: 39 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740411.988567:0:8506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f0d98dccf00) 00010000:00010000:3.0:1790740411.988606:0:8506:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790740411.988632:0:8506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc12afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec599375-3198-45fd-a23a-c5620f07177c+38:2369:x1877727133090944:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 107us (1228us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740411.988639:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 6 00000100:00100000:3.0:1790740411.999611:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740411.999968:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133091072 00000100:00100000:1.0:1790740411.999979:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133091072 00000100:00100000:1.0:1790740412.000035:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 36 00000100:00100000:1.0:1790740412.000044:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec599375-3198-45fd-a23a-c5620f07177c+8:2372:x1877727133091072:12345-192.168.203.58@tcp:1:lfs.0 00010000:00010000:1.0:1790740412.000086:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fd3a7db/0xc6b31a1b598ea364 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.000106:0:6699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000425923b/0xc6b31a1b598ea325 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee55e expref: 8 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.000114:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790740412.000118:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790740412.000122:0:6699:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006fd3a7db/0xc6b31a1b598ea364 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.000167:0:6699:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000425923b/0xc6b31a1b598ea325 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee55e expref: 8 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.000180:0:6699:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000425923b/0xc6b31a1b598ea325 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee55e expref: 8 pid: 6700 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740412.000194:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db6dc2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6699:1877727158274432:192.168.203.58@tcp:104: 00000100:00100000:1.0:1790740412.000300:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d87573cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790740412.005066:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db6dc2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6699:1877727158274432:192.168.203.58@tcp:104: 00010000:00010000:2.0:1790740412.005118:0:6699:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006fd3a7db/0xc6b31a1b598ea364 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740412.012960:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740412.013380:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133091200 00000100:00100000:1.0:1790740412.013389:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133091200 00002000:00100000:1.0:1790740412.013436:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8f0dbee6f100 x1877727133091200/t0(0) o4->ec599375-3198-45fd-a23a-c5620f07177c@192.168.203.58@tcp:468/0 lens 504/0 e 0 to 0 dl 1790740423 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790740412.013446:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f0dbee6f100 with x1877727133091200 ext(0->8) 00010000:00010000:1.0:1790740412.013456:0:6706:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000000425923b/0xc6b31a1b598ea325 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee55e expref: 9 pid: 6700 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.013484:0:6706:0:(ldlm_lockd.c:610:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000000425923b/0xc6b31a1b598ea325 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee55e expref: 9 pid: 6700 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790740412.013493:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8f0dbee6f100 00000100:00100000:1.0:1790740412.013521:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 1 00000100:00100000:1.0:1790740412.013532:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ec599375-3198-45fd-a23a-c5620f07177c+9:2370:x1877727133091200:12345-192.168.203.58@tcp:4:lfs.0 00000100:00100000:1.0:1790740412.014352:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ec599375-3198-45fd-a23a-c5620f07177c+11:2370:x1877727133091200:12345-192.168.203.58@tcp:4:lfs.0 Request processed in 819us (1399us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1790740412.014369:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 1 00002000:00100000:1.0:1790740412.014378:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8f0dbee6f100 x1877727133091200/t4294967302(0) o4->ec599375-3198-45fd-a23a-c5620f07177c@192.168.203.58@tcp:468/0 lens 504/448 e 0 to 0 dl 1790740423 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790740412.014387:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f0dbee6f100 with x1877727133091200 ext(0->8) 00010000:00010000:1.0:1790740412.014394:0:6706:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000000425923b/0xc6b31a1b598ea325 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee55e expref: 11 pid: 6700 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.014411:0:6706:0:(ldlm_lockd.c:610:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000000425923b/0xc6b31a1b598ea325 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee55e expref: 11 pid: 6700 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790740412.014419:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8f0dbee6f100 00000040:00080000:3.0:1790740412.017375:0:11679:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790740412.017394:0:11679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790740412.017438:0:11679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1790740412.017447:0:11679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790740412.024743:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740412.026543:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133091328 00000100:00100000:2.0:1790740412.026557:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133091328 00010000:00010000:2.0:1790740412.026620:0:5830:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000425923b/0xc6b31a1b598ea325 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee55e expref: 11 pid: 6700 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740412.026669:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 50 00000100:00100000:2.0:1790740412.026679:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db6dc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec599375-3198-45fd-a23a-c5620f07177c+11:2369:x1877727133091328:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790740412.026694:0:5830:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1790740412.026712:0:5830:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1790740412.026715:0:5830:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1790740411 00002000:00010000:2.0:1790740412.026717:0:5830:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1790740412 00002000:00010000:2.0:1790740412.026719:0:5830:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1790740411 00010000:00010000:2.0:1790740412.026726:0:5830:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000425923b/0xc6b31a1b598ea325 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee55e expref: 11 pid: 6700 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740412.026752:0:5830:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000425923b/0xc6b31a1b598ea325 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee55e expref: 11 pid: 6700 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740412.026775:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000425923b/0xc6b31a1b598ea325 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee55e expref: 11 pid: 6700 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740412.026968:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790740412.026973:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790740412.026993:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006fd3a7db/0xc6b31a1b598ea364 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740412.027004:0:5830:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006fd3a7db/0xc6b31a1b598ea364 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740412.027040:0:5830:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790740412.027166:0:6699:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006fd3a7db/0xc6b31a1b598ea364 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.027178:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006fd3a7db/0xc6b31a1b598ea364 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.027212:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fd3a7db/0xc6b31a1b598ea364 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.027222:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006fd3a7db/0xc6b31a1b598ea364 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.027230:0:6699:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006fd3a7db/0xc6b31a1b598ea364 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.027245:0:6699:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f976000 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:1.0:1790740412.027250:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006fd3a7db/0xc6b31a1b598ea364 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.027260:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006fd3a7db/0xc6b31a1b598ea364 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.027274:0:6699:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006fd3a7db/0xc6b31a1b598ea364 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.027283:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006fd3a7db/0xc6b31a1b598ea364 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740412.027357:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db6dc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec599375-3198-45fd-a23a-c5620f07177c+10:2369:x1877727133091328:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 679us (2632us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740412.027365:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 50 00000100:00100000:1.0:1790740412.030111:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec599375-3198-45fd-a23a-c5620f07177c+9:2372:x1877727133091072:12345-192.168.203.58@tcp:1:lfs.0 Request processed in 30047us (30527us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740412.030126:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 36 00000100:00100000:2.0:1790740412.033748:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740412.034058:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133091584 00000100:00100000:1.0:1790740412.034069:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133091584 00000100:00100000:1.0:1790740412.034127:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 26 00000100:00100000:1.0:1790740412.034136:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0da2039c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+38:10515:x1877727133091584:12345-192.168.203.58@tcp:35:lfs.0 00000004:00010000:1.0:1790740412.034194:0:5846:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598ea356 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee573 expref: 38 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790740412.034440:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:1.0:1790740412.034483:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:1.0:1790740412.035062:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:1.0:1790740412.035124:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598ea36b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.035141:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea310 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee550 expref: 42 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.035151:0:5846:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598ea36b lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.035188:0:5846:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea310 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee550 expref: 42 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.035214:0:5846:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea310 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee550 expref: 42 pid: 8666 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740412.035229:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db6dc3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5846:1877727158274560:192.168.203.58@tcp:104: 00000100:00100000:1.0:1790740412.035318:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d875736c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790740412.037804:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db6dc3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5846:1877727158274560:192.168.203.58@tcp:104: 00010000:00010000:1.0:1790740412.037833:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598ea36b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740412.042738:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740412.043052:0:8506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133091712 00000100:00100000:3.0:1790740412.043063:0:8506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133091712 00010000:00010000:3.0:1790740412.043115:0:8506:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea310 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee550 expref: 43 pid: 8666 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740412.043156:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 51 00000100:00100000:3.0:1790740412.043165:0:8506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc12ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec599375-3198-45fd-a23a-c5620f07177c+43:2370:x1877727133091712:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790740412.043179:0:8506:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740412.043186:0:8506:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea310 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee550 expref: 43 pid: 8666 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740412.043198:0:8506:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea310 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee550 expref: 43 pid: 8666 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740412.043230:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea310 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee550 expref: 43 pid: 8666 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740412.043243:0:8506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f0d98dccf00) 00010000:00010000:3.0:1790740412.043248:0:8506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598ea36b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740412.043257:0:8506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598ea36b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740412.043264:0:8506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598ea36b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740412.043312:0:8506:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790740412.043351:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598ea36b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.043361:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598ea36b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740412.043374:0:8506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc12ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec599375-3198-45fd-a23a-c5620f07177c+42:2370:x1877727133091712:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 209us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740412.043382:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 51 00000001:00080000:1.0:1790740412.043497:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1790740412.043720:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:1.0:1790740412.043977:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db6dc3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1877727158274688:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1790740412.044034:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740412.044069:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d87573a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790740412.044079:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158274688 00000100:00100000:3.0:1790740412.044087:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158274688 00000100:00100000:3.0:1790740412.044132:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790740412.044140:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db6dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5846:x1877727158274688:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1790740412.044219:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db6dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5846:x1877727158274688:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 79us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740412.044225:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790740412.045291:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db6dc3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1877727158274688:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1790740412.046031:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1790740412.046129:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db6dc3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1877727158274816:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1790740412.046179:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740412.046276:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d8486cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1790740412.049978:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158274816 00000100:00100000:3.0:1790740412.049994:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158274816 00000100:00100000:3.0:1790740412.050057:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790740412.050067:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db6dc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5846:x1877727158274816:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1790740412.050688:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db6dc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5846:x1877727158274816:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 622us (4507us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1790740412.050697:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790740412.050927:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db6dc3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1877727158274816:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1790740412.050994:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:1.0:1790740412.051037:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598ea36b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.051048:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598ea36b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.051057:0:5846:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598ea36b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.051063:0:5846:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f977000 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1790740412.051067:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598ea36b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.051075:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598ea36b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.051092:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f0d98dccf00) 00010000:00010000:1.0:1790740412.051096:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1790740412.051100:0:5846:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598ea36b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.051126:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598ea36b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790740412.051330:0:5846:0:(mdd_object.c:4180:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1790740412.051480:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:1.0:1790740412.051493:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 328001919383ns, next at 329001917221ns, rc = 0 00000001:00080000:1.0:1790740412.051499:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1790740412.051529:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f0d98dccf00) 00010000:00010000:1.0:1790740412.051532:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1790740412.051539:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598ea356 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee573 expref: 46 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740412.052135:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0da2039c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+45:10515:x1877727133091584:12345-192.168.203.58@tcp:35:lfs.0 Request processed in 17997us (18407us total) trans 4294967388 rc 0/0 00000100:00100000:1.0:1790740412.052145:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 26 00000020:00080000:1.0:1790740412.052150:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1790740412.059894:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740412.059977:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133091840 00000100:00100000:1.0:1790740412.059987:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133091840 00000100:00100000:1.0:1790740412.060039:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 100 00000100:00100000:1.0:1790740412.060049:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc12ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+45:10515:x1877727133091840:12345-192.168.203.58@tcp:101:lfs.0 00010000:00010000:1.0:1790740412.060073:0:5844:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740412.060093:0:5844:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598ea372 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee57a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.060158:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598ea372 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee57a expref: 46 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.060192:0:5844:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598ea372 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee57a expref: 46 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.060222:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f0d84a1ef00) 00010000:00010000:1.0:1790740412.060225:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790740412.060229:0:5844:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9f977000, rc 0) 00000100:00100000:1.0:1790740412.060286:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc12ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+46:10515:x1877727133091840:12345-192.168.203.58@tcp:101:lfs.0 Request processed in 239us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740412.060294:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 100 00000100:00100000:2.0:1790740412.064689:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740412.064988:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133092096 00000100:00100000:3.0:1790740412.064998:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133092096 00000100:00100000:3.0:1790740412.065061:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 27 00000100:00100000:3.0:1790740412.065072:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc12ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec599375-3198-45fd-a23a-c5620f07177c+46:10515:x1877727133092096:12345-192.168.203.58@tcp:35:lfs.0 00000100:00100000:3.0:1790740412.065338:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc12ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec599375-3198-45fd-a23a-c5620f07177c+47:10515:x1877727133092096:12345-192.168.203.58@tcp:35:lfs.0 Request processed in 267us (655us total) trans 4294967389 rc 0/0 00000100:00100000:3.0:1790740412.065347:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 27 00000004:00080000:2.0:1790740412.208852:0:8152:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 328159277513ns, next at 329159275516ns, rc = 0 00000100:00100000:0.0:1790740412.208929:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc12ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158274944:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790740412.208998:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740412.209450:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740412.209650:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133092224 00000100:00100000:1.0:1790740412.209658:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133092224 00000100:00100000:1.0:1790740412.209714:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 101 00000100:00100000:1.0:1790740412.209724:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1696d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+47:10525:x1877727133092224:12345-192.168.203.58@tcp:34:lfs.0 00010000:00010000:1.0:1790740412.209805:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea379 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.209825:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea379 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.209835:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea379 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.209850:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea380 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.209856:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea380 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.209879:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea380 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.209961:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea387 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.209970:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea387 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.209976:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea387 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790740412.210013:0:5842:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea387 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.210024:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea379 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.210031:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea379 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.210038:0:5842:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea379 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.210043:0:5842:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f976000 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1790740412.210047:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea379 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.210055:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea379 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.210067:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f0d98dccb00) 00010000:00010000:1.0:1790740412.210077:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740412.210083:0:5842:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea379 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.210088:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea379 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.210220:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea380 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.210343:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea380 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.210350:0:5842:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea380 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.210356:0:5842:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f977800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1790740412.210359:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea380 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.210364:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea380 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.210373:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8f0d84a1ed00) 00010000:00010000:1.0:1790740412.210375:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740412.210378:0:5842:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea380 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.210383:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea380 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.210402:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea387 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.210414:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea387 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.210420:0:5842:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea387 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.210425:0:5842:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f976600 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1790740412.210428:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea387 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.210434:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea387 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.210442:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f0d84a1ef00) 00010000:00010000:1.0:1790740412.210444:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740412.210447:0:5842:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea387 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.210453:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea387 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740412.210533:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1696d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+47:10525:x1877727133092224:12345-192.168.203.58@tcp:34:lfs.0 Request processed in 809us (1084us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740412.210541:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 101 00000100:00100000:2.0:1790740412.210615:0:6703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158274944 00000100:00100000:2.0:1790740412.210621:0:6703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158274944 00000100:00100000:2.0:1790740412.210672:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1790740412.210682:0:6703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1697480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1877727158274944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790740412.210711:0:6703:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790740412.210762:0:6703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1697480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1877727158274944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (1764us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740412.210769:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1790740412.210835:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc12ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158274944:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1790740412.210977:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790740412.264627:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740412.264718:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133092480 00000100:00100000:1.0:1790740412.264728:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133092480 00000100:00100000:1.0:1790740412.264801:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 102 00000100:00100000:1.0:1790740412.264811:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc12ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+47:10528:x1877727133092480:12345-192.168.203.58@tcp:101:lfs.0 00010000:00010000:1.0:1790740412.264848:0:5844:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740412.264868:0:5844:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea38e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee581 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.264936:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea395 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.264952:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea395 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.264965:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea395 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.264979:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea39c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.264987:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea39c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.264993:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea39c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.265357:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6a00/0xc6b31a1b598ea3a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.265366:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6a00/0xc6b31a1b598ea3a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.265375:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6a00/0xc6b31a1b598ea3a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790740412.265385:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1790740412.265491:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea395 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.265500:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea395 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.265507:0:5844:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea395 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.265512:0:5844:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f977800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1790740412.265517:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea395 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.265524:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea395 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.265536:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f0d98dccb00) 00010000:00010000:1.0:1790740412.265539:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740412.265543:0:5844:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea395 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.265549:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea395 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.265567:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea39c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.265617:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea39c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.265623:0:5844:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea39c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.265628:0:5844:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f976000 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1790740412.265638:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea39c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.265645:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea39c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.265653:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8f0d84a1ed00) 00010000:00010000:1.0:1790740412.265655:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740412.265657:0:5844:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea39c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.265662:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea39c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.265706:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea38e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee581 expref: 50 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.265719:0:5844:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6a00/0xc6b31a1b598ea3a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee581 expref: 49 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.265725:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f0d84a1ef00) 00010000:00010000:1.0:1790740412.265727:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790740412.265729:0:5844:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9fea6a00, rc 0) 00000100:00100000:1.0:1790740412.265796:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc12ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+49:10528:x1877727133092480:12345-192.168.203.58@tcp:101:lfs.0 Request processed in 986us (1177us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1790740412.265804:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 102 00000100:00100000:3.0:1790740412.270248:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740412.270347:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133092608 00000100:00100000:2.0:1790740412.270360:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133092608 00000100:00100000:2.0:1790740412.270437:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 103 00000100:00100000:2.0:1790740412.270446:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+49:10528:x1877727133092608:12345-192.168.203.58@tcp:54:lfs.0 00010000:00010000:2.0:1790740412.270515:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595200/0xc6b31a1b598ea3b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740412.270533:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595200/0xc6b31a1b598ea3b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740412.270545:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595200/0xc6b31a1b598ea3b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740412.270591:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595200/0xc6b31a1b598ea3b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740412.270600:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595200/0xc6b31a1b598ea3b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740412.270612:0:5843:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595200/0xc6b31a1b598ea3b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740412.270618:0:5843:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87595200 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740412.270622:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595200/0xc6b31a1b598ea3b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740412.270629:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595200/0xc6b31a1b598ea3b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740412.270640:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f0d84a1ef00) 00010000:00010000:2.0:1790740412.270643:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790740412.270647:0:5843:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595200/0xc6b31a1b598ea3b1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740412.270663:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595200/0xc6b31a1b598ea3b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740412.270741:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+49:10528:x1877727133092608:12345-192.168.203.58@tcp:54:lfs.0 Request processed in 296us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740412.270749:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 103 00000100:00100000:2.0:1790740412.276006:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740412.276064:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133092864 00000100:00100000:3.0:1790740412.276075:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133092864 00000100:00100000:3.0:1790740412.276132:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 28 00000100:00100000:3.0:1790740412.276142:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc12ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec599375-3198-45fd-a23a-c5620f07177c+49:10528:x1877727133092864:12345-192.168.203.58@tcp:35:lfs.0 00000100:00100000:3.0:1790740412.277934:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc12ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec599375-3198-45fd-a23a-c5620f07177c+50:10528:x1877727133092864:12345-192.168.203.58@tcp:35:lfs.0 Request processed in 1785us (1929us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1790740412.277947:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 28 00000100:00100000:3.0:1790740412.301707:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740412.301763:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740412.301793:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740412.301831:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133092992 00000100:00100000:2.0:1790740412.301841:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133092992 00000100:00100000:3.0:1790740412.301844:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740412.301875:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133093376 00000100:00100000:3.0:1790740412.301880:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133093376 00000100:00080000:3.0:1790740412.301908:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790740412.301910:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 290 00000100:00100000:2.0:1790740412.301923:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83fed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:2371:x1877727133092992:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:3.0:1790740412.301942:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 139 00000100:00100000:3.0:1790740412.301952:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+5:2371:x1877727133093376:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:0.0:1790740412.302042:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133093248 00000100:00100000:0.0:1790740412.302046:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133093248 00000100:00100000:0.0:1790740412.302078:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133093120 00000100:00100000:0.0:1790740412.302081:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133093120 00000100:00100000:0.0:1790740412.302098:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 76 00000100:00100000:0.0:1790740412.302105:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec599375-3198-45fd-a23a-c5620f07177c+8:2371:x1877727133093248:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:3.0:1790740412.302147:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+5:2371:x1877727133093376:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 47us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740412.302159:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 139 00000100:00100000:1.0:1790740412.302291:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 77 00000100:00100000:1.0:1790740412.302302:0:8460:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec599375-3198-45fd-a23a-c5620f07177c+9:2371:x1877727133093120:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:2.0:1790740412.302725:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83fed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:2371:x1877727133092992:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 803us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740412.302734:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 290 00000100:00080000:2.0:1790740412.302845:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790740412.311624:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec599375-3198-45fd-a23a-c5620f07177c+8:2371:x1877727133093248:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 9506us (9848us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740412.311639:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 76 00000100:00100000:1.0:1790740412.313467:0:8460:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec599375-3198-45fd-a23a-c5620f07177c+9:2371:x1877727133093120:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 11158us (11663us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740412.313497:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 77 00000100:00100000:2.0:1790740412.394971:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740412.395077:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133093632 00000100:00100000:3.0:1790740412.395087:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133093632 00000100:00100000:3.0:1790740412.395159:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 104 00000100:00100000:3.0:1790740412.395170:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc12adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+50:10539:x1877727133093632:12345-192.168.203.58@tcp:101:bash.0 00010000:00010000:3.0:1790740412.395194:0:5843:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740412.395197:0:5843:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1790740412.395352:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea333 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee565 expref: 50 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740412.395370:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f0d98dccb00) 00010000:00010000:3.0:1790740412.395375:0:5843:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790740412.395388:0:5843:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fa00/0xc6b31a1b598ea3b8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee588 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740412.395478:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f800/0xc6b31a1b598ea3bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740412.395491:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f800/0xc6b31a1b598ea3bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740412.395501:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f800/0xc6b31a1b598ea3bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790740412.395512:0:5843:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1790740412.395689:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fa00/0xc6b31a1b598ea3b8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee588 expref: 52 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740412.395703:0:5843:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f800/0xc6b31a1b598ea3bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee588 expref: 51 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740412.395711:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f0d84a1ef00) 00010000:00010000:3.0:1790740412.395714:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790740412.395717:0:5843:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0db6c0f800, rc 0) 00000100:00100000:3.0:1790740412.395772:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc12adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+51:10539:x1877727133093632:12345-192.168.203.58@tcp:101:bash.0 Request processed in 604us (811us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1790740412.395793:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 104 00000100:00100000:3.0:1790740412.402962:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740412.403262:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133093888 00000100:00100000:2.0:1790740412.403273:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133093888 00000100:00100000:2.0:1790740412.403345:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 105 00000100:00100000:2.0:1790740412.403355:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+51:10539:x1877727133093888:12345-192.168.203.58@tcp:36:bash.0 00010000:00010000:2.0:1790740412.403412:0:8666:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1790740412.403438:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f800/0xc6b31a1b598ea3bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee588 expref: 51 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740412.403460:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6a00/0xc6b31a1b598ea3a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee581 expref: 50 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740412.403489:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f0d84a1ef00) 00010000:00010000:2.0:1790740412.403494:0:8666:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790740412.403729:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595200/0xc6b31a1b598ea3cd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740412.403744:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595200/0xc6b31a1b598ea3cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740412.403753:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595200/0xc6b31a1b598ea3cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790740412.403820:0:8666:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1790740412.403845:0:8666:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000002f8a4b59 reply state 00000000657b8655 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595200/0xc6b31a1b598ea3cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740412.403854:0:8666:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790740412.403952:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+52:10539:x1877727133093888:12345-192.168.203.58@tcp:36:bash.0 Request processed in 597us (997us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1790740412.403960:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 105 00000020:00080000:2.0:1790740412.403965:0:8666:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790740412.410270:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595200/0xc6b31a1b598ea3cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740412.410288:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595200/0xc6b31a1b598ea3cd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740412.410296:0:3289:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595200/0xc6b31a1b598ea3cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740412.410302:0:3289:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87595200 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740412.410324:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595200/0xc6b31a1b598ea3cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740412.410332:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595200/0xc6b31a1b598ea3cd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740412.410350:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f0d84a1ef00) 00010000:00010000:2.0:1790740412.410353:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740412.410358:0:3289:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595200/0xc6b31a1b598ea3cd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740412.410366:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595200/0xc6b31a1b598ea3cd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740412.412660:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740412.413044:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133094016 00000100:00100000:2.0:1790740412.413054:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133094016 00000100:00100000:2.0:1790740412.413121:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 106 00000100:00100000:2.0:1790740412.413132:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+51:10539:x1877727133094016:12345-192.168.203.58@tcp:101:bash.0 00010000:00010000:2.0:1790740412.413157:0:5843:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740412.413177:0:5843:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598ea3d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee58f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740412.413272:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598ea3db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740412.413287:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598ea3db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740412.413298:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598ea3db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740412.413324:0:5843:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1790740412.413339:0:5843:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790740412.413360:0:5843:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598ea3db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740412.413386:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598ea3d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee58f expref: 53 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740412.413402:0:5843:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598ea3db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee58f expref: 52 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740412.413411:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f0d84a1ef00) 00010000:00010000:2.0:1790740412.413414:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790740412.413417:0:5843:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d87594400, rc 0) 00000100:00100000:2.0:1790740412.413476:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+52:10539:x1877727133094016:12345-192.168.203.58@tcp:101:bash.0 Request processed in 347us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740412.413483:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 106 00000100:00100000:0.0:1790740412.418314:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740412.418406:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133094272 00000100:00100000:1.0:1790740412.418416:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133094272 00000100:00100000:1.0:1790740412.418471:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 29 00000100:00100000:1.0:1790740412.418482:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1694a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+52:10539:x1877727133094272:12345-192.168.203.58@tcp:35:bash.0 00000100:00100000:1.0:1790740412.418903:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1694a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+53:10539:x1877727133094272:12345-192.168.203.58@tcp:35:bash.0 Request processed in 421us (598us total) trans 4294967395 rc 0/0 00000100:00100000:1.0:1790740412.418912:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 29 00000100:00100000:3.0:1790740412.515143:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740412.516325:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133094400 00000100:00100000:2.0:1790740412.516336:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133094400 00000100:00100000:2.0:1790740412.516445:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 107 00000100:00100000:2.0:1790740412.516455:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+53:10545:x1877727133094400:12345-192.168.203.58@tcp:101:lfs.0 00010000:00010000:2.0:1790740412.516478:0:8666:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740412.516497:0:8666:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598ea3e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee596 expref: -99 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740412.516556:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595200/0xc6b31a1b598ea3e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740412.516569:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595200/0xc6b31a1b598ea3e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740412.516646:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595200/0xc6b31a1b598ea3e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740412.516680:0:8666:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1790740412.516684:0:8666:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790740412.516700:0:8666:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595200/0xc6b31a1b598ea3e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740412.516724:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598ea3e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee596 expref: 55 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740412.516756:0:8666:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595200/0xc6b31a1b598ea3e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee596 expref: 54 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740412.516768:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f0d98dccb00) 00010000:00010000:2.0:1790740412.516771:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790740412.516941:0:8666:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d87595200, rc 0) 00000100:00100000:2.0:1790740412.516999:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+54:10545:x1877727133094400:12345-192.168.203.58@tcp:101:lfs.0 Request processed in 545us (1866us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740412.517006:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 107 00000100:00100000:2.0:1790740412.525369:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740412.526084:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133094528 00000100:00100000:3.0:1790740412.526095:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133094528 00000100:00100000:3.0:1790740412.526218:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 108 00000100:00100000:3.0:1790740412.526230:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc12af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+54:10545:x1877727133094528:12345-192.168.203.58@tcp:101:lfs.0 00010000:00010000:3.0:1790740412.526250:0:5843:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740412.526272:0:5843:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e200/0xc6b31a1b598ea3f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee59d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740412.526336:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fa00/0xc6b31a1b598ea3f7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740412.526351:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fa00/0xc6b31a1b598ea3f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740412.526362:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fa00/0xc6b31a1b598ea3f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740412.526375:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ec00/0xc6b31a1b598ea3fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740412.526383:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ec00/0xc6b31a1b598ea3fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740412.526390:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ec00/0xc6b31a1b598ea3fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740412.526561:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f200/0xc6b31a1b598ea405 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740412.526608:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f200/0xc6b31a1b598ea405 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740412.526616:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f200/0xc6b31a1b598ea405 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790740412.526943:0:5843:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1790740412.526948:0:5843:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790740412.526971:0:5843:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f200/0xc6b31a1b598ea405 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740412.526983:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f200/0xc6b31a1b598ea405 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740412.526992:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fa00/0xc6b31a1b598ea3f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740412.526997:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fa00/0xc6b31a1b598ea3f7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740412.527004:0:5843:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fa00/0xc6b31a1b598ea3f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740412.527009:0:5843:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0fa00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1790740412.527014:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fa00/0xc6b31a1b598ea3f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740412.527020:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fa00/0xc6b31a1b598ea3f7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740412.527032:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f0d98dccb00) 00010000:00010000:3.0:1790740412.527035:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740412.527047:0:5843:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fa00/0xc6b31a1b598ea3f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740412.527054:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fa00/0xc6b31a1b598ea3f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740412.527066:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ec00/0xc6b31a1b598ea3fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740412.527072:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ec00/0xc6b31a1b598ea3fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740412.527077:0:5843:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ec00/0xc6b31a1b598ea3fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740412.527082:0:5843:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0ec00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1790740412.527085:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ec00/0xc6b31a1b598ea3fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740412.527090:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ec00/0xc6b31a1b598ea3fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740412.527099:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8f0d944f6800) 00010000:00010000:3.0:1790740412.527101:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740412.527104:0:5843:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ec00/0xc6b31a1b598ea3fe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740412.527110:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ec00/0xc6b31a1b598ea3fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740412.527142:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e200/0xc6b31a1b598ea3f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee59d expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740412.527168:0:5843:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f200/0xc6b31a1b598ea405 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee59d expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740412.527176:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f0d84a1ef00) 00010000:00010000:3.0:1790740412.527178:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790740412.527181:0:5843:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0db6c0f200, rc 0) 00000100:00100000:3.0:1790740412.527263:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc12af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+55:10545:x1877727133094528:12345-192.168.203.58@tcp:101:lfs.0 Request processed in 1032us (1899us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740412.527271:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 108 00000100:00100000:0.0:1790740412.536709:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740412.536801:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740412.537352:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133094912 00000100:00100000:3.0:1790740412.537363:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133094912 00000100:00100000:3.0:1790740412.537428:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 7 00000100:00100000:3.0:1790740412.537444:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1695c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec599375-3198-45fd-a23a-c5620f07177c+55:2369:x1877727133094912:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790740412.537625:0:5829:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740412.537650:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f200/0xc6b31a1b598ea405 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee59d expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740412.537670:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f0d84a1ef00) 00010000:00010000:3.0:1790740412.537676:0:5829:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740412.537899:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133094784 00000100:00100000:1.0:1790740412.537905:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133094784 00000100:00100000:1.0:1790740412.537942:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 109 00000100:00100000:1.0:1790740412.537951:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1695180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+55:10545:x1877727133094784:12345-192.168.203.58@tcp:101:lfs.0 00010000:00010000:1.0:1790740412.537966:0:5844:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740412.537982:0:5844:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6a00/0xc6b31a1b598ea40c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee5a4 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.538070:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea413 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.538084:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598ea3db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee58f expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.538092:0:5844:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea413 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.538124:0:5844:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598ea3db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee58f expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.538157:0:5844:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598ea3db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee58f expref: 56 pid: 5843 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740412.538170:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db6dc3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1877727158275072:192.168.203.58@tcp:104: 00000100:00100000:3.0:1790740412.538316:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1695c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec599375-3198-45fd-a23a-c5620f07177c+56:2369:x1877727133094912:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 879us (1514us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740412.538324:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 7 00000100:00100000:1.0:1790740412.539583:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d8486c000 going to sleep for 11 seconds 00000100:00100000:1.0:1790740412.554895:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db6dc3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1877727158275072:192.168.203.58@tcp:104: 00010000:00010000:1.0:1790740412.554927:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea413 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740412.555737:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740412.555829:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133095040 00000100:00100000:1.0:1790740412.555837:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133095040 00010000:00010000:1.0:1790740412.555873:0:5828:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598ea3db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee58f expref: 56 pid: 5843 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740412.555909:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 52 00000100:00100000:1.0:1790740412.555918:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1697b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec599375-3198-45fd-a23a-c5620f07177c+56:2369:x1877727133095040:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790740412.555932:0:5828:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740412.555937:0:5828:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598ea3db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee58f expref: 56 pid: 5843 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.555949:0:5828:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598ea3db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee58f expref: 56 pid: 5843 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.555970:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598ea3db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee58f expref: 56 pid: 5843 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.556001:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f0d84a1ef00) 00010000:00010000:1.0:1790740412.556006:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea413 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.556015:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea413 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.556023:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea413 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740412.556071:0:5828:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740412.556129:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1697b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec599375-3198-45fd-a23a-c5620f07177c+55:2369:x1877727133095040:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 212us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740412.556137:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 52 00010000:00010000:2.0:1790740412.558450:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea413 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740412.558465:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea413 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740412.558488:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1790740412.558686:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6a00/0xc6b31a1b598ea40c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5a4 expref: 56 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740412.558707:0:5844:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea413 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5a4 expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740412.558717:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f0d84a1ef00) 00010000:00010000:2.0:1790740412.558720:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790740412.558723:0:5844:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9f976600, rc 0) 00000100:00100000:2.0:1790740412.558789:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1695180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+55:10545:x1877727133094784:12345-192.168.203.58@tcp:101:lfs.0 Request processed in 20840us (22090us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1790740412.558798:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 109 00000100:00100000:0.0:1790740412.568234:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740412.568364:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133095296 00000100:00100000:2.0:1790740412.568375:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133095296 00000100:00100000:2.0:1790740412.568461:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 8 00000100:00100000:2.0:1790740412.568471:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1695880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec599375-3198-45fd-a23a-c5620f07177c+55:10545:x1877727133095296:12345-192.168.203.58@tcp:103:lfs.0 00010000:00010000:2.0:1790740412.568488:0:5830:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740412.568513:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598ea372 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee57a expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740412.568540:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f0d84a1ef00) 00010000:00010000:2.0:1790740412.568545:0:5830:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790740412.568664:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1695880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec599375-3198-45fd-a23a-c5620f07177c+54:10545:x1877727133095296:12345-192.168.203.58@tcp:103:lfs.0 Request processed in 194us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740412.568671:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 8 00000100:00100000:1.0:1790740412.575519:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740412.575622:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133095424 00000100:00100000:2.0:1790740412.575632:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133095424 00000100:00100000:2.0:1790740412.575702:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 110 00000100:00100000:2.0:1790740412.575713:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db6dc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+54:10545:x1877727133095424:12345-192.168.203.58@tcp:58:lfs.0 00010000:00010000:2.0:1790740412.575841:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598ea421 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740412.575859:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598ea421 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740412.575872:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598ea421 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790740412.576056:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1790740412.576154:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db6dc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+54:10545:x1877727133095424:12345-192.168.203.58@tcp:58:lfs.0 Request processed in 442us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740412.576162:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 110 00000100:00100000:3.0:1790740412.579761:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740412.580252:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133095552 00000100:00100000:0.0:1790740412.580263:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133095552 00000100:00100000:0.0:1790740412.580331:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 111 00000100:00100000:0.0:1790740412.580341:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+54:10545:x1877727133095552:12345-192.168.203.58@tcp:101:lfs.0 00010000:00010000:0.0:1790740412.580376:0:8666:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740412.580396:0:8666:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f000/0xc6b31a1b598ea428 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee5ab expref: -99 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740412.580450:0:8666:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598ea421 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740412.580461:0:8666:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f000/0xc6b31a1b598ea428 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5ab expref: 55 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740412.580479:0:8666:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598ea421 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740412.580492:0:8666:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f000/0xc6b31a1b598ea428 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5ab expref: 55 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740412.580505:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f0d84a1ef00) 00010000:00010000:0.0:1790740412.580508:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790740412.580512:0:8666:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f000/0xc6b31a1b598ea428 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5ab expref: 55 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740412.580519:0:8666:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0dc132f000, rc 0) 00000100:00100000:0.0:1790740412.580823:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+55:10545:x1877727133095552:12345-192.168.203.58@tcp:101:lfs.0 Request processed in 482us (1070us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740412.580831:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 111 00010000:00010000:3.0:1790740412.720781:0:11661:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740412.720989:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db6dc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158275200:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790740412.721085:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740412.721348:0:6703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158275200 00000100:00100000:0.0:1790740412.721357:0:6703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158275200 00000100:00100000:0.0:1790740412.721409:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790740412.721428:0:6703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3304:x1877727158275200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790740412.721452:0:6703:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 51052544 pending 3407872 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790740412.721633:0:6703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3304:x1877727158275200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 206us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740412.721640:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790740412.721722:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db6dc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158275200:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1790740413.041240:0:11679:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790740413.041249:0:11679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790740413.041313:0:11679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1790740413.041323:0:11679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790740413.041463:0:11679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbee1aa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11679:1877727158275328:192.168.203.58@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790740413.041641:0:11679:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0db6f3ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1790740413.052963:0:11679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbee1aa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11679:1877727158275328:192.168.203.58@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790740413.061675:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740413.061759:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133095680 00000100:00100000:3.0:1790740413.061770:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133095680 00000100:00100000:3.0:1790740413.061843:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 112 00000100:00100000:3.0:1790740413.061855:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db6dc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+55:10546:x1877727133095680:12345-192.168.203.58@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790740413.061940:0:5843:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790740413.062049:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db6dc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+55:10546:x1877727133095680:12345-192.168.203.58@tcp:53:lhsmtool_posix.0 Request processed in 197us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740413.062058:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 112 00000100:00080000:2.0:1790740413.062771:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790740413.076432:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740413.076633:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133095808 00000100:00100000:2.0:1790740413.076643:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133095808 00000100:00100000:2.0:1790740413.076713:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 113 00000100:00100000:2.0:1790740413.076722:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+55:10546:x1877727133095808:12345-192.168.203.58@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1790740413.076805:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea42f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.077303:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea42f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.077322:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea42f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.077402:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea436 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.077815:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea436 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.078123:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea436 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.078154:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea43d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.078164:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea43d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.078170:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea43d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740413.078224:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1790740413.078922:0:5844:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790740413.078940:0:5844:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea43d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.078954:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea42f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.079387:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea42f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.079395:0:5844:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea42f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.079921:0:5844:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87594200 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740413.079927:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea42f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.079934:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea42f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.079949:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f0d944f6600) 00010000:00010000:2.0:1790740413.079952:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740413.079957:0:5844:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea42f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.079963:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea42f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.079979:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea436 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.079985:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea436 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.079991:0:5844:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea436 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.079996:0:5844:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87594800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740413.079999:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea436 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.080004:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea436 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.080026:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff8f0d98dcc500) 00010000:00010000:2.0:1790740413.080029:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740413.080043:0:5844:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea436 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.081334:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea436 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.081361:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea43d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.081367:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea43d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.081374:0:5844:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea43d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.081379:0:5844:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87594e00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740413.081383:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea43d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.081390:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea43d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.081402:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f0d84a1ef00) 00010000:00010000:2.0:1790740413.081404:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740413.081408:0:5844:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea43d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.081422:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea43d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740413.081539:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+55:10546:x1877727133095808:12345-192.168.203.58@tcp:34:lhsmtool_posix.0 Request processed in 4814us (5124us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740413.081549:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 113 00000100:00100000:3.0:1790740413.092410:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740413.092870:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133096064 00000100:00100000:1.0:1790740413.092881:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133096064 00000100:00100000:1.0:1790740413.092949:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 114 00000100:00100000:1.0:1790740413.092960:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+55:10546:x1877727133096064:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790740413.092980:0:5842:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740413.093000:0:5842:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598ea444 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee5b2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740413.093108:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea44b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740413.093135:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea44b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740413.093158:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea44b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790740413.093170:0:5842:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1790740413.093276:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea44b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740413.093285:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea44b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740413.093293:0:5842:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea44b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740413.093299:0:5842:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f976000 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1790740413.093303:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea44b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740413.093310:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea44b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740413.093334:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f0d84a1ef00) 00010000:00010000:1.0:1790740413.093337:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790740413.093342:0:5842:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea44b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740413.093348:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea44b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740413.093392:0:5842:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598ea444 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5b2 expref: 57 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740413.093420:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f0d944f6600) 00010000:00010000:1.0:1790740413.093424:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790740413.093428:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598ea444 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5b2 expref: 57 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740413.093442:0:5842:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9f977000, rc 0) 00000100:00100000:1.0:1790740413.094236:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+56:10546:x1877727133096064:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 Request processed in 1274us (1832us total) trans 4294967397 rc 301/301 00000100:00100000:1.0:1790740413.094245:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 114 00000100:00100000:1.0:1790740413.098947:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740413.099083:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133096192 00000100:00100000:0.0:1790740413.099095:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133096192 00000100:00100000:0.0:1790740413.099149:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 115 00000100:00100000:0.0:1790740413.099162:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db6dc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+56:10546:x1877727133096192:12345-192.168.203.58@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790740413.099210:0:8666:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790740413.099310:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db6dc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+56:10546:x1877727133096192:12345-192.168.203.58@tcp:53:lhsmtool_posix.0 Request processed in 149us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740413.099318:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 115 00000100:00100000:2.0:1790740413.109071:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740413.109312:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133096448 00000100:00100000:1.0:1790740413.109321:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133096448 00000100:00100000:1.0:1790740413.109379:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 116 00000100:00100000:1.0:1790740413.109389:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc12ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+56:10546:x1877727133096448:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790740413.109418:0:5842:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740413.109421:0:5842:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1790740413.109454:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595200/0xc6b31a1b598ea3e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee596 expref: 56 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740413.109474:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f0d98dccb00) 00010000:00010000:1.0:1790740413.109480:0:5842:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790740413.109493:0:5842:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598ea459 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee5b9 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790740413.110285:0:5842:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1790740413.110742:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea460 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740413.110758:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea460 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740413.110768:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea460 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740413.111158:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598ea459 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5b9 expref: 58 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740413.111187:0:5842:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea460 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5b9 expref: 57 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740413.111207:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8f0d84a1ed00) 00010000:00010000:1.0:1790740413.111210:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790740413.111213:0:5842:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9f976000, rc 0) 00000100:00100000:1.0:1790740413.111299:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc12ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+57:10546:x1877727133096448:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 Request processed in 1911us (2237us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1790740413.111314:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 116 00000100:00100000:3.0:1790740413.119802:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740413.119899:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133096704 00000100:00100000:0.0:1790740413.119908:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133096704 00000100:00100000:0.0:1790740413.119968:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 117 00000100:00100000:0.0:1790740413.119979:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+57:10546:x1877727133096704:12345-192.168.203.58@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790740413.120051:0:8666:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740413.120078:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea460 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5b9 expref: 57 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740413.120102:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8f0d84a1ed00) 00010000:00010000:0.0:1790740413.120112:0:8666:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790740413.120131:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fc00/0xc6b31a1b598ea46e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740413.120146:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fc00/0xc6b31a1b598ea46e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740413.120170:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fc00/0xc6b31a1b598ea46e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740413.120184:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e000/0xc6b31a1b598ea475 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xee65189e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740413.120191:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e000/0xc6b31a1b598ea475 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xee65189e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740413.120211:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e000/0xc6b31a1b598ea475 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xee65189e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740413.120276:0:8666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fc00/0xc6b31a1b598ea46e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740413.120284:0:8666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fc00/0xc6b31a1b598ea46e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740413.120292:0:8666:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fc00/0xc6b31a1b598ea46e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740413.120298:0:8666:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132fc00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1790740413.120302:0:8666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fc00/0xc6b31a1b598ea46e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740413.120311:0:8666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fc00/0xc6b31a1b598ea46e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740413.120320:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f0d98dccb00) 00010000:00010000:0.0:1790740413.120323:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740413.120327:0:8666:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fc00/0xc6b31a1b598ea46e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740413.120339:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fc00/0xc6b31a1b598ea46e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740413.120350:0:8666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e000/0xc6b31a1b598ea475 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xee65189e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740413.120356:0:8666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e000/0xc6b31a1b598ea475 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xee65189e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740413.120362:0:8666:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e000/0xc6b31a1b598ea475 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xee65189e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740413.120366:0:8666:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132e000 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1790740413.120369:0:8666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e000/0xc6b31a1b598ea475 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xee65189e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740413.120376:0:8666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e000/0xc6b31a1b598ea475 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xee65189e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740413.120383:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xee65189e (ffff8f0d82841500) 00010000:00010000:0.0:1790740413.120385:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740413.120388:0:8666:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e000/0xc6b31a1b598ea475 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xee65189e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740413.120394:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e000/0xc6b31a1b598ea475 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xee65189e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740413.120484:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+56:10546:x1877727133096704:12345-192.168.203.58@tcp:36:lhsmtool_posix.0 Request processed in 506us (689us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790740413.120491:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 117 00000100:00100000:2.0:1790740413.127000:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740413.127400:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133096832 00000100:00100000:1.0:1790740413.127418:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133096832 00000100:00100000:1.0:1790740413.127609:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 118 00000100:00100000:1.0:1790740413.127619:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc12adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+56:10546:x1877727133096832:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790740413.127638:0:5842:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740413.127660:0:5842:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598ea47c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee5c0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740413.127716:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea483 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740413.127730:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea483 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740413.127742:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea483 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740413.127845:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598ea47c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5c0 expref: 58 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740413.127867:0:5842:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea483 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5c0 expref: 57 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740413.127876:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8f0d84a1eb00) 00010000:00010000:1.0:1790740413.127879:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790740413.127882:0:5842:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9f976000, rc 0) 00000100:00100000:1.0:1790740413.128650:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc12adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+57:10546:x1877727133096832:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 Request processed in 1028us (1654us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740413.128658:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 118 00000100:00100000:3.0:1790740413.133264:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740413.133359:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133097088 00000100:00100000:0.0:1790740413.133369:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133097088 00000100:00100000:0.0:1790740413.133432:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 119 00000100:00100000:0.0:1790740413.133450:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8654a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+57:10546:x1877727133097088:12345-192.168.203.58@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790740413.133536:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fc00/0xc6b31a1b598ea48a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740413.133555:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fc00/0xc6b31a1b598ea48a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740413.133568:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fc00/0xc6b31a1b598ea48a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790740413.133857:0:8666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00010000:0.0:1790740413.133936:0:8666:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000c23ac5bf reply state 000000006c2a7319 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fc00/0xc6b31a1b598ea48a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740413.133946:0:8666:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790740413.135980:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8654a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+59:10546:x1877727133097088:12345-192.168.203.58@tcp:36:lhsmtool_posix.0 Request processed in 591us (776us total) trans 4294967399 rc 0/0 00000100:00100000:0.0:1790740413.135999:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 119 00000100:00100000:0.0:1790740413.139339:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00010000:00010000:3.0:1790740413.140622:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fc00/0xc6b31a1b598ea48a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740413.140638:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fc00/0xc6b31a1b598ea48a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740413.140647:0:3290:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fc00/0xc6b31a1b598ea48a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740413.140670:0:3290:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132fc00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1790740413.140685:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fc00/0xc6b31a1b598ea48a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740413.140695:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fc00/0xc6b31a1b598ea48a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740413.140712:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8f0d84a1eb00) 00010000:00010000:3.0:1790740413.140715:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790740413.140720:0:3290:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fc00/0xc6b31a1b598ea48a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740413.140727:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fc00/0xc6b31a1b598ea48a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740413.153819:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133097216 00000100:00100000:2.0:1790740413.153890:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133097216 00000100:00100000:2.0:1790740413.153970:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 120 00000100:00100000:2.0:1790740413.153980:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1694380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+58:10546:x1877727133097216:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790740413.154004:0:5843:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740413.154023:0:5843:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea491 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee5c7 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.154081:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea491 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5c7 expref: 59 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.154096:0:5843:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea491 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5c7 expref: 59 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.154116:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8f0d84a1eb00) 00010000:00010000:2.0:1790740413.154119:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790740413.154123:0:5843:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d87594800, rc 0) 00000100:00100000:2.0:1790740413.154307:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1694380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+59:10546:x1877727133097216:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 Request processed in 327us (14976us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740413.154315:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 120 00000100:00100000:3.0:1790740413.162551:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740413.162649:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133097344 00000100:00100000:2.0:1790740413.162680:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133097344 00000100:00100000:2.0:1790740413.162749:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 37 00000100:00100000:2.0:1790740413.162758:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8654b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec599375-3198-45fd-a23a-c5620f07177c+8:2370:x1877727133097344:12345-192.168.203.58@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1790740413.165379:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8654b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec599375-3198-45fd-a23a-c5620f07177c+9:2370:x1877727133097344:12345-192.168.203.58@tcp:2:lhsmtool_posix.0 Request processed in 2611us (2826us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1790740413.165395:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 37 00000100:00100000:3.0:1790740413.174537:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740413.174808:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133097600 00000100:00100000:1.0:1790740413.174818:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133097600 00000100:00100000:1.0:1790740413.175548:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 30 00000100:00100000:1.0:1790740413.175560:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8654a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+59:10546:x1877727133097600:12345-192.168.203.58@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1790740413.176538:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8654a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+60:10546:x1877727133097600:12345-192.168.203.58@tcp:35:lhsmtool_posix.0 Request processed in 976us (2005us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1790740413.176568:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 30 00000100:00100000:1.0:1790740413.182492:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740413.182690:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133097856 00000100:00100000:3.0:1790740413.182700:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133097856 00000100:00100000:3.0:1790740413.182768:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 121 00000100:00100000:3.0:1790740413.182778:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8498fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+60:10546:x1877727133097856:12345-192.168.203.58@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790740413.183071:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8498fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+60:10546:x1877727133097856:12345-192.168.203.58@tcp:57:lhsmtool_posix.0 Request processed in 294us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740413.183080:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 121 00000100:00100000:0.0:1790740413.186924:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740413.188496:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133097984 00000100:00100000:1.0:1790740413.188509:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133097984 00000100:00100000:1.0:1790740413.188672:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 122 00000100:00100000:1.0:1790740413.188683:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1a3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+60:10546:x1877727133097984:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790740413.188703:0:5842:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740413.189749:0:5842:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea498 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee5ce expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740413.190297:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598ea49f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740413.190314:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598ea49f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740413.190326:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598ea49f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790740413.190360:0:5842:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790740413.190381:0:5842:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598ea49f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740413.190409:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea498 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5ce expref: 62 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740413.190432:0:5842:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598ea49f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5ce expref: 61 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740413.190460:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8f0d84a1eb00) 00010000:00010000:1.0:1790740413.190463:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1790740413.190467:0:5842:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9f977000, rc 0) 00000100:00100000:1.0:1790740413.190544:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1a3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+61:10546:x1877727133097984:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 Request processed in 1862us (3628us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740413.190553:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 122 00000100:00100000:0.0:1790740413.200212:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740413.203160:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133098112 00000100:00100000:2.0:1790740413.203173:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133098112 00000100:00100000:2.0:1790740413.203250:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 38 00000100:00100000:2.0:1790740413.203260:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1a3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec599375-3198-45fd-a23a-c5620f07177c+9:2369:x1877727133098112:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790740413.203278:0:6700:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740413.203299:0:6700:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094de3bc1/0xc6b31a1b598ea4a6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee5d5 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790740413.203325:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abc87bd, blocks: 0x1 00010000:00010000:2.0:1790740413.203344:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=329s v=(0 0) 00010000:00010000:2.0:1790740413.203348:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790740413.203356:0:6700:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094de3bc1/0xc6b31a1b598ea4a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5d5 expref: 10 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.203373:0:6700:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000094de3bc1/0xc6b31a1b598ea4a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5d5 expref: 10 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.203387:0:6700:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d87594200, rc 0) 00000100:00100000:2.0:1790740413.203564:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1a3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec599375-3198-45fd-a23a-c5620f07177c+10:2369:x1877727133098112:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 Request processed in 305us (3370us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740413.203633:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 38 00000100:00100000:3.0:1790740413.212499:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740413.212672:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133098368 00000100:00100000:0.0:1790740413.212682:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133098368 00000100:00100000:0.0:1790740413.212740:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 123 00000100:00100000:0.0:1790740413.212751:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+61:10546:x1877727133098368:12345-192.168.203.58@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790740413.212880:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+61:10546:x1877727133098368:12345-192.168.203.58@tcp:57:lhsmtool_posix.0 Request processed in 130us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740413.212901:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 123 00000100:00100000:0.0:1790740413.219451:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740413.219654:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133098496 00000100:00100000:2.0:1790740413.219664:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133098496 00000100:00100000:2.0:1790740413.219725:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 39 00000100:00100000:2.0:1790740413.219735:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1a3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec599375-3198-45fd-a23a-c5620f07177c+10:10546:x1877727133098496:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790740413.219753:0:6699:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740413.219772:0:6699:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002060d9c8/0xc6b31a1b598ea4ad lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee5dc expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.219803:0:6699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000094de3bc1/0xc6b31a1b598ea4a6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5d5 expref: 11 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.219812:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790740413.219816:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790740413.219821:0:6699:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002060d9c8/0xc6b31a1b598ea4ad lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5dc expref: 11 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.219856:0:6699:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000094de3bc1/0xc6b31a1b598ea4a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5d5 expref: 11 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.219870:0:6699:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000094de3bc1/0xc6b31a1b598ea4a6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5d5 expref: 11 pid: 6700 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740413.219885:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc12aed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6699:1877727158275456:192.168.203.58@tcp:104: 00000100:00100000:0.0:1790740413.226217:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0db6ff63c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790740413.230848:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740413.230968:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc12aed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6699:1877727158275456:192.168.203.58@tcp:104: 00010000:00010000:0.0:1790740413.231001:0:6699:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002060d9c8/0xc6b31a1b598ea4ad lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5dc expref: 11 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740413.231022:0:6699:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d87595c00, rc 0) 00000100:00100000:0.0:1790740413.231092:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1a3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec599375-3198-45fd-a23a-c5620f07177c+11:10546:x1877727133098496:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 Request processed in 11358us (11659us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740413.231100:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 39 00000100:00100000:2.0:1790740413.231621:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133098624 00000100:00100000:2.0:1790740413.231644:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133098624 00010000:00010000:2.0:1790740413.231677:0:5828:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000094de3bc1/0xc6b31a1b598ea4a6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5d5 expref: 11 pid: 6700 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740413.231718:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 53 00000100:00100000:2.0:1790740413.231728:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d87402c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec599375-3198-45fd-a23a-c5620f07177c+11:2369:x1877727133098624:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790740413.231742:0:5828:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740413.231763:0:5828:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000094de3bc1/0xc6b31a1b598ea4a6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5d5 expref: 11 pid: 6700 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.231776:0:5828:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000094de3bc1/0xc6b31a1b598ea4a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5d5 expref: 11 pid: 6700 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.231798:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094de3bc1/0xc6b31a1b598ea4a6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5d5 expref: 11 pid: 6700 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.231812:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790740413.231816:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790740413.231825:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002060d9c8/0xc6b31a1b598ea4ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5dc expref: 10 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.231835:0:5828:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002060d9c8/0xc6b31a1b598ea4ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5dc expref: 10 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.231872:0:5828:0:(ldlm_lockd.c:1085:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002060d9c8/0xc6b31a1b598ea4ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5dc expref: 10 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740413.231900:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc12aea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5828:1877727158275584:192.168.203.58@tcp:105: 00000100:00100000:2.0:1790740413.231966:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0db6ff63c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790740413.238774:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc12aea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5828:1877727158275584:192.168.203.58@tcp:105: 00010000:00010000:1.0:1790740413.238801:0:5828:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740413.238854:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d87402c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec599375-3198-45fd-a23a-c5620f07177c+10:2369:x1877727133098624:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 7127us (8013us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740413.238865:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 53 00000100:00100000:1.0:1790740413.243891:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740413.243961:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133098752 00000100:00100000:3.0:1790740413.243971:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133098752 00002000:00100000:3.0:1790740413.244019:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8f0db6dc1c00 x1877727133098752/t0(0) o4->ec599375-3198-45fd-a23a-c5620f07177c@192.168.203.58@tcp:469/0 lens 504/0 e 0 to 0 dl 1790740424 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790740413.244037:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f0db6dc1c00 with x1877727133098752 ext(0->12) 00002000:00010000:3.0:1790740413.244043:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f0db6dc1c00 00000100:00100000:3.0:1790740413.244213:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 2 00000100:00100000:3.0:1790740413.244223:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db6dc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ec599375-3198-45fd-a23a-c5620f07177c+10:2371:x1877727133098752:12345-192.168.203.58@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1790740413.245187:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db6dc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ec599375-3198-45fd-a23a-c5620f07177c+12:2371:x1877727133098752:12345-192.168.203.58@tcp:4:lhsmtool_posix.0 Request processed in 961us (1298us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1790740413.245207:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 2 00002000:00100000:3.0:1790740413.245216:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8f0db6dc1c00 x1877727133098752/t4294967308(0) o4->ec599375-3198-45fd-a23a-c5620f07177c@192.168.203.58@tcp:469/0 lens 504/448 e 0 to 0 dl 1790740424 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790740413.245227:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f0db6dc1c00 with x1877727133098752 ext(0->12) 00002000:00010000:3.0:1790740413.245232:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f0db6dc1c00 00000100:00100000:0.0:1790740413.249814:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740413.251972:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133098880 00000100:00100000:3.0:1790740413.251986:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133098880 00000100:00100000:3.0:1790740413.252050:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 124 00000100:00100000:3.0:1790740413.252060:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+61:10546:x1877727133098880:12345-192.168.203.58@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1790740413.339841:0:5865:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000020:00080000:0.0:1790740413.339864:0:5865:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f0dbd398a80 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1790740413.339869:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f0d87ea7700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f0dbd398f00 00000020:00080000:0.0:1790740413.339873:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f0d87ea7e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f0dbebf2c00 00000001:00080000:0.0:1790740413.339893:0:5865:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:0.0:1790740413.339907:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:0.0:1790740413.339922:0:5865:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f0d87573a80 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1790740413.339925:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f0dbee3b000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f0d87573240 00000020:00080000:0.0:1790740413.339927:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f0dbee3b500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f0dc1b6b000 00000004:00080000:0.0:1790740413.339975:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000100:00100000:3.0:1790740413.340152:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+15:10546:x1877727133098880:12345-192.168.203.58@tcp:44:lhsmtool_posix.0 Request processed in 88017us (90270us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740413.340164:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 124 00000100:00100000:0.0:1790740413.340176:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd7d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158275712:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1790740413.340238:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740413.340306:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd7d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158275840:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1790740413.340317:0:8460:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158275712 00000100:00100000:0.0:1790740413.340324:0:8460:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158275712 00000100:00100000:0.0:1790740413.340370:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790740413.340379:0:8460:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd7d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3305:x1877727158275712:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1790740413.340404:0:8460:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:0.0:1790740413.340434:0:8460:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6abc87bb, atime: 0x6abc87bc, ctime: 0x6abc87bb, blocks: 0xb 00010000:00010000:0.0:1790740413.340443:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008890b629/0xc6b31a1b598ea4b4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740413.340460:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=329s v=(0 0) 00010000:00010000:0.0:1790740413.340464:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00000100:00100000:3.0:1790740413.340465:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790740413.340471:0:8460:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008890b629/0xc6b31a1b598ea4b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740413.340488:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008890b629/0xc6b31a1b598ea4b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740413.340499:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008890b629/0xc6b31a1b598ea4b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740413.340507:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008890b629/0xc6b31a1b598ea4b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740413.340524:0:8460:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1790740413.340771:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158275840 00000100:00100000:3.0:1790740413.340776:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158275840 00000100:00100000:3.0:1790740413.340799:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790740413.340812:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1877727158275840:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1790740413.340825:0:6701:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:3.0:1790740413.340838:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7dde186/0xc6b31a1b598ea4bb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740413.340852:0:6701:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002d19dd53/0xc6b31a1b598ea276 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee53b expref: 11 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740413.340860:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1790740413.340863:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790740413.340866:0:6701:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7dde186/0xc6b31a1b598ea4bb lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740413.340890:0:6701:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002d19dd53/0xc6b31a1b598ea276 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee53b expref: 11 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740413.340903:0:6701:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002d19dd53/0xc6b31a1b598ea276 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee53b expref: 11 pid: 8460 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740413.340914:0:6701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda71880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6701:1877727158275968:192.168.203.58@tcp:104: 00000100:00100000:3.0:1790740413.340956:0:6701:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0db6f3b540 going to sleep for 11 seconds 00000100:00100000:0.0:1790740413.341123:0:8460:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd7d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3305:x1877727158275712:12345-0@lo:6:osp-syn-0-0.0 Request processed in 745us (884us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1790740413.341131:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1790740413.341158:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790740413.341170:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790740413.341177:0:5832:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008890b629/0xc6b31a1b598ea4b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740413.341186:0:5832:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132e800 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:0.0:1790740413.341203:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008890b629/0xc6b31a1b598ea4b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740413.341213:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008890b629/0xc6b31a1b598ea4b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740413.341228:0:5832:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008890b629/0xc6b31a1b598ea4b4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740413.341235:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008890b629/0xc6b31a1b598ea4b4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740413.341254:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740413.341256:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740413.341258:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1790740413.341309:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1790740413.341428:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000004:00080000:3.0:1790740413.342330:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f0dbd7d7100/2, rc 0, transno 4294967304 00000100:00100000:3.0:1790740413.342340:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd7d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158275712:0@lo:6:osp-syn-0-0.0 00000001:00080000:1.0:1790740413.343884:0:6725:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00080000:1.0:1790740413.343900:0:6725:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:1.0:1790740413.343909:0:6725:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00080000:1.0:1790740413.343916:0:6725:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:3.0:1790740413.348186:0:6701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda71880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6701:1877727158275968:192.168.203.58@tcp:104: 00010000:00010000:3.0:1790740413.348226:0:6701:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a7dde186/0xc6b31a1b598ea4bb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740413.353023:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740413.353380:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133099008 00000100:00100000:0.0:1790740413.353390:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133099008 00010000:00010000:0.0:1790740413.353435:0:5829:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002d19dd53/0xc6b31a1b598ea276 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee53b expref: 12 pid: 8460 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740413.353481:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 54 00000100:00100000:0.0:1790740413.353491:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec599375-3198-45fd-a23a-c5620f07177c+12:2370:x1877727133099008:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790740413.353521:0:5829:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740413.353528:0:5829:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002d19dd53/0xc6b31a1b598ea276 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee53b expref: 12 pid: 8460 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740413.353548:0:5829:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002d19dd53/0xc6b31a1b598ea276 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee53b expref: 12 pid: 8460 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740413.353616:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d19dd53/0xc6b31a1b598ea276 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee53b expref: 12 pid: 8460 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740413.353839:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790740413.353843:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790740413.353849:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a7dde186/0xc6b31a1b598ea4bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740413.353858:0:5829:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7dde186/0xc6b31a1b598ea4bb lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740413.353890:0:5829:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740413.353952:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec599375-3198-45fd-a23a-c5620f07177c+11:2370:x1877727133099008:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 462us (939us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740413.353959:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 54 00010000:00010000:3.0:1790740413.354028:0:6701:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a7dde186/0xc6b31a1b598ea4bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740413.354038:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7dde186/0xc6b31a1b598ea4bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740413.354049:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7dde186/0xc6b31a1b598ea4bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740413.354057:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a7dde186/0xc6b31a1b598ea4bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740413.354078:0:6701:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1790740413.354670:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3306:x1877727158275840:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13857us (14202us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1790740413.354679:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:2.0:1790740413.355045:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f0dbd7d7800/2, rc 0, transno 4294967309 00000100:00100000:2.0:1790740413.355065:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd7d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158275840:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1790740413.355864:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740413.355937:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133099136 00000100:00100000:3.0:1790740413.355945:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133099136 00000100:00100000:3.0:1790740413.355993:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 42 00000100:00100000:3.0:1790740413.356003:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1695c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec599375-3198-45fd-a23a-c5620f07177c+11:2370:x1877727133099136:12345-192.168.203.58@tcp:16:lhsmtool_posix.0 00010000:00010000:0.0:1790740413.358833:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790740413.358846:0:5831:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a7dde186/0xc6b31a1b598ea4bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740413.358878:0:5831:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0e200 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:0.0:1790740413.358883:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7dde186/0xc6b31a1b598ea4bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740413.358894:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7dde186/0xc6b31a1b598ea4bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740413.358915:0:5831:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a7dde186/0xc6b31a1b598ea4bb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740413.358922:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7dde186/0xc6b31a1b598ea4bb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740413.358944:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740413.358946:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740413.358947:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1790740413.439535:0:7642:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:2.0:1790740413.439551:0:7642:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:2.0:1790740413.439559:0:7642:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:2.0:1790740413.439565:0:7642:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:0.0:1790740413.439747:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1695c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec599375-3198-45fd-a23a-c5620f07177c+6:2370:x1877727133099136:12345-192.168.203.58@tcp:16:lhsmtool_posix.0 Request processed in 83739us (83880us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740413.439758:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 42 00000100:00100000:3.0:1790740413.442751:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740413.443224:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133099392 00000100:00100000:0.0:1790740413.443234:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133099392 00000100:00100000:0.0:1790740413.443297:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 125 00000100:00100000:0.0:1790740413.443307:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+15:10546:x1877727133099392:12345-192.168.203.58@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790740413.443359:0:8666:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740413.443385:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598ea49f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5ce expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740413.443425:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8f0d84a1eb00) 00010000:00010000:0.0:1790740413.443430:0:8666:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790740413.443460:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e800/0xc6b31a1b598ea4c2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740413.443474:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e800/0xc6b31a1b598ea4c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740413.443484:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e800/0xc6b31a1b598ea4c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790740413.443969:0:8666:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000001732a540 reply state 00000000e7b24b4c transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e800/0xc6b31a1b598ea4c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740413.443980:0:8666:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790740413.444173:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+16:10546:x1877727133099392:12345-192.168.203.58@tcp:36:lhsmtool_posix.0 Request processed in 865us (1428us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1790740413.444181:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 125 00000100:00100000:1.0:1790740413.447545:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00010000:00010000:2.0:1790740413.447814:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e800/0xc6b31a1b598ea4c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.447827:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e800/0xc6b31a1b598ea4c2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.447835:0:3289:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e800/0xc6b31a1b598ea4c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.447841:0:3289:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132e800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740413.447846:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e800/0xc6b31a1b598ea4c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.447854:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e800/0xc6b31a1b598ea4c2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.447870:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8f0d84a1eb00) 00010000:00010000:2.0:1790740413.447873:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740413.447879:0:3289:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e800/0xc6b31a1b598ea4c2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.447902:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e800/0xc6b31a1b598ea4c2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740413.448509:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133099520 00000100:00100000:3.0:1790740413.448520:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133099520 00000100:00100000:3.0:1790740413.448932:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 43 00000100:00100000:3.0:1790740413.448952:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1697b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec599375-3198-45fd-a23a-c5620f07177c+6:2369:x1877727133099520:12345-192.168.203.58@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1790740413.449218:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1790740413.449222:0:6700:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1790740412 00002000:00010000:3.0:1790740413.449224:0:6700:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1790740412 00002000:00010000:3.0:1790740413.449226:0:6700:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1790740413 -> 1790740412 00002000:00010000:3.0:1790740413.449228:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1790740413.449291:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1697b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec599375-3198-45fd-a23a-c5620f07177c+7:2369:x1877727133099520:12345-192.168.203.58@tcp:2:lhsmtool_posix.0 Request processed in 341us (1755us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1790740413.449299:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 43 00000100:00100000:1.0:1790740413.451896:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740413.451973:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133099776 00000100:00100000:0.0:1790740413.451982:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133099776 00000100:00100000:0.0:1790740413.452064:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 126 00000100:00100000:0.0:1790740413.452075:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1695880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+15:10546:x1877727133099776:12345-192.168.203.58@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1790740413.452145:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598ea4c9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740413.452162:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea483 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5c0 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740413.452190:0:5842:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598ea4c9 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740413.452240:0:5842:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea483 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5c0 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740413.452253:0:5842:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea483 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5c0 expref: 15 pid: 5842 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740413.452268:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd7d6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1877727158276096:192.168.203.58@tcp:104: 00000100:00100000:0.0:1790740413.452381:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d985ba480 going to sleep for 11 seconds 00000100:00100000:2.0:1790740413.455563:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740413.455701:0:8506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133099904 00000100:00100000:3.0:1790740413.455710:0:8506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133099904 00010000:00010000:3.0:1790740413.455758:0:8506:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea483 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5c0 expref: 16 pid: 5842 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740413.455792:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 55 00000100:00100000:3.0:1790740413.455801:0:8506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc12ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec599375-3198-45fd-a23a-c5620f07177c+16:2370:x1877727133099904:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790740413.455818:0:8506:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740413.455826:0:8506:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea483 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5c0 expref: 16 pid: 5842 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740413.455839:0:8506:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea483 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5c0 expref: 16 pid: 5842 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740413.455860:0:8506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8f0d84a1eb00) 00010000:00010000:3.0:1790740413.455867:0:8506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598ea4c9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740413.455894:0:8506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598ea4c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740413.455902:0:8506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598ea4c9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740413.455920:0:8506:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790740413.455964:0:8506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc12ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec599375-3198-45fd-a23a-c5620f07177c+16:2370:x1877727133099904:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 164us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740413.455972:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 55 00010000:00010000:0.0:1790740413.457509:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea483 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5c0 expref: 15 pid: 5842 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740413.457536:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd7d6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1877727158276096:192.168.203.58@tcp:104: 00010000:00010000:0.0:1790740413.457561:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598ea4c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740413.457806:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598ea4c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740413.457814:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598ea4c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740413.457855:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598ea4c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740413.457862:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598ea4c9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740413.457868:0:5842:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598ea4c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740413.457874:0:5842:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132e600 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1790740413.457878:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598ea4c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740413.457885:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598ea4c9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740413.457898:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8f0d84a1eb00) 00010000:00010000:1.0:1790740413.457901:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1790740413.457905:0:5842:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598ea4c9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740413.457911:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598ea4c9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740413.458013:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1695880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+14:10546:x1877727133099776:12345-192.168.203.58@tcp:55:lhsmtool_posix.0 Request processed in 5938us (6122us total) trans 0 rc -22/-22 00000100:00100000:1.0:1790740413.458022:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 126 00000100:00100000:2.0:1790740413.464884:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740413.465075:0:8460:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133100032 00000100:00100000:0.0:1790740413.465085:0:8460:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133100032 00000100:00100000:0.0:1790740413.465180:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 44 00000100:00100000:0.0:1790740413.465191:0:8460:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc12ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec599375-3198-45fd-a23a-c5620f07177c+7:2369:x1877727133100032:12345-192.168.203.58@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1790740413.465246:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d61f48cd/0xc6b31a1b598ea4d0 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740413.465268:0:8460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002060d9c8/0xc6b31a1b598ea4ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5dc expref: 7 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740413.465292:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740413.465296:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790740413.465301:0:8460:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d61f48cd/0xc6b31a1b598ea4d0 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740413.465338:0:8460:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002060d9c8/0xc6b31a1b598ea4ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5dc expref: 7 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740413.465351:0:8460:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002060d9c8/0xc6b31a1b598ea4ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5dc expref: 7 pid: 6699 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740413.465366:0:8460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd7d6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8460:1877727158276224:192.168.203.58@tcp:104: 00000100:00100000:0.0:1790740413.465446:0:8460:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d985ba480 going to sleep for 11 seconds 00000100:00100000:0.0:1790740413.469390:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740413.469972:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133100160 00000100:00100000:2.0:1790740413.469982:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133100160 00010000:00010000:2.0:1790740413.470020:0:5830:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002060d9c8/0xc6b31a1b598ea4ad lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5dc expref: 8 pid: 6699 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740413.470063:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 56 00000100:00100000:2.0:1790740413.470083:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d84916300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec599375-3198-45fd-a23a-c5620f07177c+8:2369:x1877727133100160:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790740413.470098:0:5830:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740413.470119:0:5830:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002060d9c8/0xc6b31a1b598ea4ad lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5dc expref: 8 pid: 6699 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.470133:0:5830:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002060d9c8/0xc6b31a1b598ea4ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5dc expref: 8 pid: 6699 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.470159:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790740413.470163:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790740413.470169:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d61f48cd/0xc6b31a1b598ea4d0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.470178:0:5830:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d61f48cd/0xc6b31a1b598ea4d0 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.470230:0:5830:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790740413.470287:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d84916300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec599375-3198-45fd-a23a-c5620f07177c+8:2369:x1877727133100160:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 215us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740413.470295:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 56 00010000:00010000:1.0:1790740413.472228:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002060d9c8/0xc6b31a1b598ea4ad lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5dc expref: 7 pid: 6699 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740413.472271:0:8460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd7d6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8460:1877727158276224:192.168.203.58@tcp:104: 00010000:00010000:1.0:1790740413.472302:0:8460:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d61f48cd/0xc6b31a1b598ea4d0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740413.472313:0:8460:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d61f48cd/0xc6b31a1b598ea4d0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740413.472321:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d61f48cd/0xc6b31a1b598ea4d0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740413.472352:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d61f48cd/0xc6b31a1b598ea4d0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740413.472361:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d61f48cd/0xc6b31a1b598ea4d0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740413.472369:0:8460:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d61f48cd/0xc6b31a1b598ea4d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740413.472376:0:8460:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132ea00 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:1.0:1790740413.472380:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d61f48cd/0xc6b31a1b598ea4d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740413.472389:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d61f48cd/0xc6b31a1b598ea4d0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740413.472413:0:8460:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d61f48cd/0xc6b31a1b598ea4d0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740413.472556:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d61f48cd/0xc6b31a1b598ea4d0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740413.473054:0:8460:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc12ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec599375-3198-45fd-a23a-c5620f07177c+6:2369:x1877727133100032:12345-192.168.203.58@tcp:1:lhsmtool_posix.0 Request processed in 7864us (8179us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740413.473065:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 44 00000100:00100000:0.0:1790740413.475803:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740413.475896:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133100416 00000100:00100000:3.0:1790740413.475906:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133100416 00000100:00100000:3.0:1790740413.475990:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 127 00000100:00100000:3.0:1790740413.475999:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d84916d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+14:10546:x1877727133100416:12345-192.168.203.58@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1790740413.476071:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ec00/0xc6b31a1b598ea4d7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740413.476089:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ec00/0xc6b31a1b598ea4d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740413.476098:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ec00/0xc6b31a1b598ea4d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740413.476300:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f200/0xc6b31a1b598ea4de lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740413.476312:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea491 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5c7 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740413.476338:0:5844:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f200/0xc6b31a1b598ea4de lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740413.476373:0:5844:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea491 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5c7 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740413.476388:0:5844:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea491 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5c7 expref: 15 pid: 5843 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740413.476403:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d87e21c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1877727158276352:192.168.203.58@tcp:104: 00000100:00100000:3.0:1790740413.476487:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0db6f3b540 going to sleep for 11 seconds 00000100:00100000:3.0:1790740413.478906:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d87e21c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1877727158276352:192.168.203.58@tcp:104: 00010000:00010000:3.0:1790740413.478934:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f200/0xc6b31a1b598ea4de lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740413.481323:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740413.481937:0:8506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133100544 00000100:00100000:3.0:1790740413.481947:0:8506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133100544 00010000:00010000:3.0:1790740413.481988:0:8506:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea491 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5c7 expref: 16 pid: 5843 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740413.482030:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 57 00000100:00100000:3.0:1790740413.482040:0:8506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d84917480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec599375-3198-45fd-a23a-c5620f07177c+16:2370:x1877727133100544:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790740413.482057:0:8506:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740413.482064:0:8506:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea491 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5c7 expref: 16 pid: 5843 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740413.482227:0:8506:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea491 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5c7 expref: 16 pid: 5843 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740413.482248:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea491 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5c7 expref: 16 pid: 5843 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740413.482262:0:8506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8f0d84a1eb00) 00010000:00010000:3.0:1790740413.482268:0:8506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f200/0xc6b31a1b598ea4de lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740413.482276:0:8506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f200/0xc6b31a1b598ea4de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740413.482283:0:8506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f200/0xc6b31a1b598ea4de lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740413.482314:0:8506:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790740413.482372:0:8506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d84917480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec599375-3198-45fd-a23a-c5620f07177c+15:2370:x1877727133100544:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 333us (1057us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740413.482379:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 57 00010000:00010000:2.0:1790740413.482449:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f200/0xc6b31a1b598ea4de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.482457:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f200/0xc6b31a1b598ea4de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790740413.482656:0:5844:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:2.0:1790740413.482811:0:5844:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1790740413.482857:0:5844:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:2.0:1790740413.482942:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc12ac000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5844:1877727158276480:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1790740413.482993:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740413.483019:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d9921b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790740413.483088:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158276480 00000100:00100000:1.0:1790740413.483095:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158276480 00000100:00100000:1.0:1790740413.483129:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790740413.483136:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc12aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1877727158276480:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1790740413.483216:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc12aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1877727158276480:12345-0@lo:1000:mdt00_002.0 Request processed in 81us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740413.483223:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790740413.483459:0:5844:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:2.0:1790740413.483465:0:5844:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:2.0:1790740413.483481:0:5844:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f0dbd7d7800, transno 4294967309 00000100:00100000:2.0:1790740413.483504:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc12ac000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5844:1877727158276480:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1790740413.485262:0:5844:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:2.0:1790740413.485347:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc12ac000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5844:1877727158276608:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1790740413.485414:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740413.485439:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d9921b540 going to sleep for 11 seconds 00000100:00100000:1.0:1790740413.486160:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158276608 00000100:00100000:1.0:1790740413.486168:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158276608 00000100:00100000:1.0:1790740413.486223:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790740413.486232:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc12afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1877727158276608:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1790740413.486448:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc12afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5844:x1877727158276608:12345-0@lo:1000:mdt00_002.0 Request processed in 216us (1033us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1790740413.486456:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790740413.486776:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc12ac000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5844:1877727158276608:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1790740413.486814:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f200/0xc6b31a1b598ea4de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.486836:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f200/0xc6b31a1b598ea4de lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.486844:0:5844:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f200/0xc6b31a1b598ea4de lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.486851:0:5844:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0f200 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740413.486856:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f200/0xc6b31a1b598ea4de lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.486864:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f200/0xc6b31a1b598ea4de lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.486880:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8f0d84a1eb00) 00010000:00010000:2.0:1790740413.486883:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790740413.486887:0:5844:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f200/0xc6b31a1b598ea4de lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.486894:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f200/0xc6b31a1b598ea4de lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.486921:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598ea421 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.486926:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598ea421 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.486932:0:5844:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598ea421 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.486936:0:5844:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87595e00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740413.486944:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598ea421 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.486951:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598ea421 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.486959:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f0d84a1ef00) 00010000:00010000:2.0:1790740413.486961:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790740413.486968:0:5844:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f000/0xc6b31a1b598ea428 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5ab expref: 18 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.486980:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f000/0xc6b31a1b598ea428 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5ab expref: 18 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.486990:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f000/0xc6b31a1b598ea428 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5ab expref: 18 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.487019:0:5844:0:(ldlm_lockd.c:1085:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f000/0xc6b31a1b598ea428 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5ab expref: 18 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740413.487032:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc12ae300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1877727158276736:192.168.203.58@tcp:105: 00000100:00100000:2.0:1790740413.487108:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d9921b540 going to sleep for 11 seconds 00000100:00100000:1.0:1790740413.492464:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740413.492535:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133100672 00000100:00100000:3.0:1790740413.492544:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133100672 00000100:00100000:3.0:1790740413.492628:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 31 00000100:00100000:3.0:1790740413.492638:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd7d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec599375-3198-45fd-a23a-c5620f07177c+19:10545:x1877727133100672:12345-192.168.203.58@tcp:49:lfs.0 00000100:00100000:3.0:1790740413.492769:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd7d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec599375-3198-45fd-a23a-c5620f07177c+19:10545:x1877727133100672:12345-192.168.203.58@tcp:49:lfs.0 Request processed in 133us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740413.492777:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 31 00000100:00100000:2.0:1790740413.493486:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc12ae300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1877727158276736:192.168.203.58@tcp:105: 00010000:00010000:2.0:1790740413.493512:0:5844:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598ea421 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.493522:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598ea421 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.493562:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea4e5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.493596:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea4e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.493608:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea4e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.494373:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea4e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.494385:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea4e5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.494391:0:5844:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea4e5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.494397:0:5844:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87595800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740413.494401:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea4e5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.494408:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea4e5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.494421:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f0d84a1ef00) 00010000:00010000:2.0:1790740413.494424:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740413.494428:0:5844:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea4e5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.494434:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea4e5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.494457:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ec00/0xc6b31a1b598ea4d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.494463:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ec00/0xc6b31a1b598ea4d7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.494470:0:5844:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ec00/0xc6b31a1b598ea4d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.494475:0:5844:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0ec00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740413.494478:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ec00/0xc6b31a1b598ea4d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.494484:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ec00/0xc6b31a1b598ea4d7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.494492:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f0d84a1ef00) 00010000:00010000:2.0:1790740413.494495:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790740413.494498:0:5844:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ec00/0xc6b31a1b598ea4d7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.494504:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ec00/0xc6b31a1b598ea4d7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740413.494919:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d84916d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+18:10546:x1877727133100416:12345-192.168.203.58@tcp:57:lhsmtool_posix.0 Request processed in 18917us (19120us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1790740413.494929:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 127 00000020:00080000:2.0:1790740413.494935:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1790740413.498397:0:11679:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790740413.498406:0:11679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790740413.498964:0:11679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1790740413.498973:0:11679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790740413.500272:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740413.500414:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740413.500880:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133101184 00000100:00100000:2.0:1790740413.500890:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133101184 00000100:00100000:2.0:1790740413.500945:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 32 00000100:00100000:2.0:1790740413.500955:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0da2039050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec599375-3198-45fd-a23a-c5620f07177c+18:10546:x1877727133101184:12345-192.168.203.58@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1790740413.501864:0:5845:0:(mdd_object.c:4180:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1790740413.501970:0:5845:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:2.0:1790740413.502015:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea4ec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.502033:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea4ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.502046:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea4ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.502055:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea4ec lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.502062:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea4ec lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.502068:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea4ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.502102:0:5845:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1790740413.502189:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0da2039050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec599375-3198-45fd-a23a-c5620f07177c+20:10546:x1877727133101184:12345-192.168.203.58@tcp:35:lhsmtool_posix.0 Request processed in 1233us (1773us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1790740413.502208:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 32 00000020:00080000:2.0:1790740413.502213:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790740413.502494:0:11661:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790740413.502502:0:11661:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea4ec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740413.502510:0:11661:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87594e00 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:1.0:1790740413.502515:0:11661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea4ec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740413.502524:0:11661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea4ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740413.502538:0:11661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8f0d98dccf00) 00010000:00010000:1.0:1790740413.502541:0:11661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1790740413.502546:0:11661:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea4ec lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740413.502552:0:11661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea4ec lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740413.502568:0:11661:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740413.502600:0:11661:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740413.502602:0:11661:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740413.503425:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133100928 00000100:00100000:3.0:1790740413.503434:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133100928 00000100:00100000:3.0:1790740413.503492:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 128 00000100:00100000:3.0:1790740413.503501:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd7d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+20:10545:x1877727133100928:12345-192.168.203.58@tcp:58:lfs.0 00000040:00080000:3.0:1790740413.504138:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1790740413.504237:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd7d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+20:10545:x1877727133100928:12345-192.168.203.58@tcp:58:lfs.0 Request processed in 735us (3970us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740413.504246:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 128 00000100:00100000:1.0:1790740413.541272:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740413.541366:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133101312 00000100:00100000:0.0:1790740413.541376:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133101312 00000100:00100000:0.0:1790740413.541435:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 129 00000100:00100000:0.0:1790740413.541445:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd7d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+20:10548:x1877727133101312:12345-192.168.203.58@tcp:101:lfs.0 00010000:00010000:0.0:1790740413.541470:0:8666:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740413.541491:0:8666:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f600/0xc6b31a1b598ea4f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee5e3 expref: -99 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740413.541557:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f200/0xc6b31a1b598ea4fa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740413.541679:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f200/0xc6b31a1b598ea4fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740413.541693:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f200/0xc6b31a1b598ea4fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740413.541710:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ea00/0xc6b31a1b598ea501 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740413.541717:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ea00/0xc6b31a1b598ea501 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740413.541791:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ea00/0xc6b31a1b598ea501 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740413.542047:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598ea508 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740413.542059:0:8666:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea413 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5a4 expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740413.542717:0:8666:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598ea508 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740413.542913:0:8666:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea413 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5a4 expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740413.542930:0:8666:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea413 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5a4 expref: 21 pid: 5844 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740413.542946:0:8666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1b6c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8666:1877727158276864:192.168.203.58@tcp:104: 00000100:00100000:1.0:1790740413.543064:0:8666:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d8486c780 going to sleep for 11 seconds 00000100:00100000:1.0:1790740413.547545:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740413.548058:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133101568 00000100:00100000:3.0:1790740413.548068:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133101568 00000100:00100000:3.0:1790740413.548137:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 33 00000100:00100000:3.0:1790740413.548147:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1b6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+22:5608:x1877727133101568:12345-192.168.203.58@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1790740413.548393:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1b6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+23:5608:x1877727133101568:12345-192.168.203.58@tcp:35:ldlm_bl.0 Request processed in 247us (857us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1790740413.548401:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 33 00000100:00100000:2.0:1790740413.551020:0:8666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1b6c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8666:1877727158276864:192.168.203.58@tcp:104: 00010000:00010000:2.0:1790740413.551050:0:8666:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598ea508 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740413.551493:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740413.551717:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133101696 00000100:00100000:1.0:1790740413.551788:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133101696 00010000:00010000:1.0:1790740413.551825:0:5830:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea413 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5a4 expref: 23 pid: 5844 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740413.551908:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 58 00000100:00100000:1.0:1790740413.551919:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc12ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec599375-3198-45fd-a23a-c5620f07177c+23:2369:x1877727133101696:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790740413.551934:0:5830:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740413.551942:0:5830:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea413 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5a4 expref: 23 pid: 5844 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740413.551955:0:5830:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea413 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5a4 expref: 23 pid: 5844 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740413.551977:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea413 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5a4 expref: 23 pid: 5844 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740413.551999:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f0d84a1ef00) 00010000:00010000:1.0:1790740413.552004:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598ea508 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740413.552015:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598ea508 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740413.552023:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598ea508 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740413.552080:0:5830:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790740413.552188:0:8666:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598ea508 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.552205:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598ea508 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740413.552246:0:8666:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1790740413.552251:0:8666:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790740413.552271:0:8666:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598ea508 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.552284:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598ea508 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.552294:0:8666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f200/0xc6b31a1b598ea4fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.552302:0:8666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f200/0xc6b31a1b598ea4fa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.552309:0:8666:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f200/0xc6b31a1b598ea4fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.552316:0:8666:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132f200 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740413.552320:0:8666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f200/0xc6b31a1b598ea4fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.552329:0:8666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f200/0xc6b31a1b598ea4fa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.552347:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f0d98dccb00) 00010000:00010000:2.0:1790740413.552350:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740413.552354:0:8666:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f200/0xc6b31a1b598ea4fa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.552360:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f200/0xc6b31a1b598ea4fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.552372:0:8666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ea00/0xc6b31a1b598ea501 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.552379:0:8666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ea00/0xc6b31a1b598ea501 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.552384:0:8666:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ea00/0xc6b31a1b598ea501 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.552388:0:8666:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132ea00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740413.552391:0:8666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ea00/0xc6b31a1b598ea501 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.552397:0:8666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ea00/0xc6b31a1b598ea501 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.552404:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8f0d82841300) 00010000:00010000:2.0:1790740413.552406:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740413.552409:0:8666:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ea00/0xc6b31a1b598ea501 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.552415:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ea00/0xc6b31a1b598ea501 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.552464:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f600/0xc6b31a1b598ea4f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5e3 expref: 23 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.552478:0:8666:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598ea508 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5e3 expref: 22 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740413.552485:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f0d84a1ef00) 00010000:00010000:2.0:1790740413.552487:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790740413.552490:0:8666:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0dc132e600, rc 0) 00000100:00100000:1.0:1790740413.552673:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc12ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec599375-3198-45fd-a23a-c5620f07177c+22:2369:x1877727133101696:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 755us (1179us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740413.552682:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 58 00000100:00100000:2.0:1790740413.552895:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd7d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+21:10548:x1877727133101312:12345-192.168.203.58@tcp:101:lfs.0 Request processed in 11450us (11631us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740413.552904:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 129 00010000:00010000:2.0:1790740413.746911:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790740414.398872:0:12045:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790740414.398882:0:12045:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790740414.398930:0:12045:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1790740414.398938:0:12045:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1790740414.512869:0:11679:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790740414.512877:0:11679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790740414.512908:0:11679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1790740414.512914:0:11679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790740414.513042:0:11679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc12ad180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11679:1877727158276992:192.168.203.58@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790740414.513136:0:11679:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0db6ff63c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790740414.517511:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740414.517546:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133101824 00000100:00100000:2.0:1790740414.517555:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133101824 00000100:00100000:3.0:1790740414.517599:0:11679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc12ad180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11679:1877727158276992:192.168.203.58@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790740414.517625:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 130 00000100:00100000:2.0:1790740414.517635:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc12ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+21:10560:x1877727133101824:12345-192.168.203.58@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790740414.517667:0:5842:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790740414.517777:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc12ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+21:10560:x1877727133101824:12345-192.168.203.58@tcp:53:lhsmtool_posix.0 Request processed in 142us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740414.517789:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 130 00000100:00100000:0.0:1790740414.523953:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740414.524041:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133102080 00000100:00100000:2.0:1790740414.524050:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133102080 00000100:00100000:2.0:1790740414.524108:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 131 00000100:00100000:2.0:1790740414.524118:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd03f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+21:10560:x1877727133102080:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790740414.524137:0:5844:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740414.524157:0:5844:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595200/0xc6b31a1b598ea50f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee5ea expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740414.524271:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598ea516 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740414.524288:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598ea516 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740414.524301:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598ea516 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740414.524323:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1790740414.524450:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595200/0xc6b31a1b598ea50f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5ea expref: 24 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740414.524468:0:5844:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598ea516 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5ea expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740414.524477:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f0d84a1ef00) 00010000:00010000:2.0:1790740414.524480:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790740414.524484:0:5844:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d87595400, rc 0) 00000100:00100000:2.0:1790740414.524551:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd03f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+23:10560:x1877727133102080:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 Request processed in 433us (608us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1790740414.524558:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 131 00000100:00100000:3.0:1790740414.536067:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740414.536115:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740414.536195:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133102336 00000100:00100000:1.0:1790740414.536205:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133102336 00000100:00100000:1.0:1790740414.536259:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 132 00000100:00100000:1.0:1790740414.536268:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d87e21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+23:10560:x1877727133102336:12345-192.168.203.58@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1790740414.536351:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea524 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740414.536369:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea524 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740414.536382:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea524 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740414.536561:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea524 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740414.536569:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea524 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740414.536606:0:5842:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea524 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740414.536612:0:5842:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f977800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1790740414.536616:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea524 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740414.536636:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea524 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740414.536648:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f0d84a1ef00) 00010000:00010000:1.0:1790740414.536650:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790740414.536655:0:5842:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea524 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740414.536661:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea524 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740414.536824:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d87e21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+24:10560:x1877727133102336:12345-192.168.203.58@tcp:57:lhsmtool_posix.0 Request processed in 556us (767us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1790740414.536832:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 132 00000100:00100000:1.0:1790740414.536863:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133102464 00000100:00100000:1.0:1790740414.536867:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133102464 00000100:00100000:1.0:1790740414.536897:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 9 00000100:00100000:1.0:1790740414.536904:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d87e23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec599375-3198-45fd-a23a-c5620f07177c+24:2369:x1877727133102464:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790740414.536914:0:5828:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740414.536928:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598ea516 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5ea expref: 24 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740414.536939:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f0d84a1ef00) 00010000:00010000:1.0:1790740414.536942:0:5828:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740414.536960:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d87e23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec599375-3198-45fd-a23a-c5620f07177c+23:2369:x1877727133102464:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 57us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740414.536967:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 9 00000040:00080000:1.0:1790740414.537193:0:11679:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790740414.537198:0:11679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790740414.537789:0:11679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1790740414.537797:0:11679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790740414.540467:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740414.540829:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133102720 00000100:00100000:3.0:1790740414.540840:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133102720 00000100:00100000:3.0:1790740414.540891:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 34 00000100:00100000:3.0:1790740414.540901:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd03e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+23:10560:x1877727133102720:12345-192.168.203.58@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1790740414.541132:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd03e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+24:10560:x1877727133102720:12345-192.168.203.58@tcp:35:lhsmtool_posix.0 Request processed in 232us (674us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1790740414.541140:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 34 00010000:00010000:0.0:1790740414.769198:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740415.792913:0:11661:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790740416.459963:0:12097:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790740416.459974:0:12097:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790740416.460020:0:12097:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1790740416.460028:0:12097:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790740416.697536:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740416.698105:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133102976 00000100:00100000:3.0:1790740416.698189:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133102976 00000100:00100000:3.0:1790740416.698254:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 133 00000100:00100000:3.0:1790740416.698264:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1b6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+24:10580:x1877727133102976:12345-192.168.203.58@tcp:101:lfs.0 00010000:00010000:3.0:1790740416.698287:0:8666:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740416.698306:0:8666:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fa00/0xc6b31a1b598ea52b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee5f1 expref: -99 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740416.698406:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ea00/0xc6b31a1b598ea532 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740416.698421:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ea00/0xc6b31a1b598ea532 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740416.698433:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ea00/0xc6b31a1b598ea532 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790740416.698444:0:8666:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1790740416.698567:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fa00/0xc6b31a1b598ea52b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5f1 expref: 27 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740416.698602:0:8666:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ea00/0xc6b31a1b598ea532 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5f1 expref: 26 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740416.698620:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f0d84a1ef00) 00010000:00010000:3.0:1790740416.698623:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1790740416.698626:0:8666:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0db6c0ea00, rc 0) 00000100:00100000:3.0:1790740416.698687:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1b6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+26:10580:x1877727133102976:12345-192.168.203.58@tcp:101:lfs.0 Request processed in 425us (1161us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1790740416.698694:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 133 00000100:00080000:3.0:1790740416.698722:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790740416.705308:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740416.705396:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133103104 00000100:00100000:1.0:1790740416.705406:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133103104 00000100:00100000:1.0:1790740416.705464:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 134 00000100:00100000:1.0:1790740416.705475:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd03d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+26:10580:x1877727133103104:12345-192.168.203.58@tcp:54:lfs.0 00010000:00010000:1.0:1790740416.705542:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea540 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740416.705561:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea540 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740416.705644:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea540 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740416.705672:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea540 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740416.705680:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea540 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740416.705685:0:5842:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea540 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740416.705691:0:5842:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f976600 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1790740416.705695:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea540 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740416.705718:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea540 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740416.705731:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f0d84a1ef00) 00010000:00010000:1.0:1790740416.705735:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790740416.705740:0:5842:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea540 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740416.705746:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea540 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740416.705824:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd03d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+26:10580:x1877727133103104:12345-192.168.203.58@tcp:54:lfs.0 Request processed in 350us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740416.705833:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 134 00000100:00100000:3.0:1790740416.803688:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740416.803892:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133103232 00000100:00100000:0.0:1790740416.803902:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133103232 00000100:00100000:0.0:1790740416.803994:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 45 00000100:00100000:0.0:1790740416.804003:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d87e20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec599375-3198-45fd-a23a-c5620f07177c+6:2369:x1877727133103232:12345-192.168.203.58@tcp:101:cat.0 00010000:00010000:0.0:1790740416.804018:0:6701:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740416.804034:0:6701:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e292822a/0xc6b31a1b598ea547 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee5f8 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790740416.804058:0:6701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6abc87bc, atime: 0x6abc87bc, ctime: 0x6abc87bc, blocks: 0xb 00010000:00010000:0.0:1790740416.804078:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=332s v=(0 0) 00010000:00010000:0.0:1790740416.804083:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740416.804092:0:6701:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e292822a/0xc6b31a1b598ea547 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5f8 expref: 7 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740416.804110:0:6701:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e292822a/0xc6b31a1b598ea547 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5f8 expref: 7 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740416.804122:0:6701:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0dc132fa00, rc 0) 00000100:00080000:3.0:1790740416.804520:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790740416.804554:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d87e20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec599375-3198-45fd-a23a-c5620f07177c+7:2369:x1877727133103232:12345-192.168.203.58@tcp:101:cat.0 Request processed in 551us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740416.804561:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 45 00000100:00100000:2.0:1790740416.813538:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00010000:00010000:1.0:1790740416.817876:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740416.818699:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133103360 00000100:00100000:3.0:1790740416.818712:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133103360 00002000:00100000:3.0:1790740416.818798:0:6707:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff8f0dc12aea00 x1877727133103360/t0(0) o3->ec599375-3198-45fd-a23a-c5620f07177c@192.168.203.58@tcp:472/0 lens 488/0 e 0 to 0 dl 1790740427 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790740416.818810:0:6707:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f0dc12aea00 with x1877727133103360 ext(0->4095) 00002000:00010000:3.0:1790740416.818816:0:6707:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f0dc12aea00 00000100:00100000:3.0:1790740416.818896:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 3 00000100:00100000:3.0:1790740416.818906:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc12aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ec599375-3198-45fd-a23a-c5620f07177c+7:2370:x1877727133103360:12345-192.168.203.58@tcp:3:cat.0 00000100:00100000:0.0:1790740416.821314:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc0962680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877727158277248:0@lo:400:kworker.0 00000100:00100000:0.0:1790740416.821414:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740416.823295:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd03d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3303:1877727158277120:0@lo:400:kworker.0 00000100:00100000:2.0:1790740416.823377:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740416.823419:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1293100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1877727158277632:0@lo:400:kworker.0 00000100:00100000:2.0:1790740416.823445:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740416.823777:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1292680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158277504:0@lo:400:kworker.0 00000100:00100000:3.0:1790740416.823812:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740416.823837:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790740416.823844:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d98511180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1877727158277376:0@lo:400:kworker.0 00000100:00100000:3.0:1790740416.823890:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158277504 00000100:00100000:3.0:1790740416.823899:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158277504 00000100:00100000:3.0:1790740416.823961:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1790740416.823971:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d87e23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1877727158277504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740416.824149:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d87e23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1877727158277504:12345-0@lo:400:kworker.0 Request processed in 180us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740416.824157:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:3.0:1790740416.824195:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790740416.824309:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc12aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ec599375-3198-45fd-a23a-c5620f07177c+7:2370:x1877727133103360:12345-192.168.203.58@tcp:3:cat.0 Request processed in 5404us (10780us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1790740416.824317:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 3 00002000:00100000:3.0:1790740416.824327:0:6707:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff8f0dc12aea00 x1877727133103360/t0(0) o3->ec599375-3198-45fd-a23a-c5620f07177c@192.168.203.58@tcp:472/0 lens 488/4536 e 0 to 0 dl 1790740427 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790740416.824336:0:6707:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f0dc12aea00 with x1877727133103360 ext(0->4095) 00002000:00010000:3.0:1790740416.824342:0:6707:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f0dc12aea00 00000100:00100000:0.0:1790740416.824753:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1290000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158277760:0@lo:400:kworker.0 00000100:00100000:3.0:1790740416.824775:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158277120 00000100:00100000:3.0:1790740416.824783:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158277120 00000100:00100000:3.0:1790740416.824817:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1790740416.824825:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83fec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3303:x1877727158277120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740416.825107:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83fec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3303:x1877727158277120:12345-0@lo:400:kworker.0 Request processed in 281us (1728us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740416.825115:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1790740416.825265:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd03d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3303:1877727158277120:0@lo:400:kworker.0 00000100:00100000:3.0:1790740416.825268:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158277248 00000100:00100000:3.0:1790740416.825275:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158277248 00000100:00100000:2.0:1790740416.825296:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740416.825370:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740416.825403:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158277760 00000100:00100000:0.0:1790740416.825408:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158277760 00000100:00100000:0.0:1790740416.828743:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1790740416.828772:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1877727158277760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740416.829094:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1877727158277760:12345-0@lo:400:kworker.0 Request processed in 326us (3722us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740416.829102:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790740416.829937:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158277632 00000100:00100000:3.0:1790740416.829947:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158277632 00000100:00100000:3.0:1790740416.829986:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158277376 00000100:00100000:3.0:1790740416.829989:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158277376 00000100:00100000:3.0:1790740416.830235:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1790740416.830248:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877727158277248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740416.830254:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1790740416.830261:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967303 00000004:00080000:2.0:1790740416.830284:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f0dc1b6d500, transno 4294967301 00000004:00080000:2.0:1790740416.830299:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967303 00000100:00100000:3.0:1790740416.830307:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877727158277248:12345-0@lo:400:kworker.0 Request processed in 63us (8893us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740416.830317:0:3306:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8f0dbd7d7100 x1877727158275712/t4294967304(4294967304) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1790740429 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740416.830336:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1292680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158277504:0@lo:400:kworker.0 00000100:00100000:1.0:1790740416.830474:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1790740416.830486:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc12aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877727158277632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740416.830531:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc12aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877727158277632:12345-0@lo:400:kworker.0 Request processed in 49us (7085us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740416.830541:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1790740416.830542:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1290000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158277760:0@lo:400:kworker.0 00000100:00100000:1.0:1790740416.830567:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1790740416.830596:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc0962680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877727158277248:0@lo:400:kworker.0 00000100:00100000:1.0:1790740416.830715:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc12ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877727158277376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740416.830739:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1293100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1877727158277632:0@lo:400:kworker.0 00000100:00100000:1.0:1790740416.830759:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc12ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877727158277376:12345-0@lo:400:kworker.0 Request processed in 47us (5461us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740416.830825:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d98511180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1877727158277376:0@lo:400:kworker.0 00000100:00100000:3.0:1790740416.830847:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:2.0:1790740416.830881:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790740416.830887:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790740416.830988:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000004:00080000:2.0:1790740417.328765:0:8152:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 333279190204ns, next at 334279188173ns, rc = 0 00000100:00100000:3.0:1790740417.328870:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790740417.328893:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d98511180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158277888:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790740417.328974:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740417.329174:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158277888 00000100:00100000:1.0:1790740417.329183:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158277888 00000100:00100000:1.0:1790740417.329251:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1790740417.329260:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d87e22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1877727158277888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790740417.329296:0:6704:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790740417.330728:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d87e22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1877727158277888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1463us (1747us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740417.330740:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790740417.330999:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d98511180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158277888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790740417.429068:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740417.429119:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740417.429149:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740417.429189:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740417.429212:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740417.429244:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133104000 00000100:00100000:1.0:1790740417.429253:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133104000 00000100:00100000:1.0:1790740417.429308:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133103616 00000100:00100000:1.0:1790740417.429312:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133103616 00000100:00100000:1.0:1790740417.429335:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 143 00000100:00100000:1.0:1790740417.429345:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1b6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+5:2372:x1877727133104000:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:2.0:1790740417.429602:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133103488 00000100:00100000:2.0:1790740417.429607:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133103488 00000100:00100000:2.0:1790740417.429637:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 292 00000100:00100000:2.0:1790740417.429644:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:2372:x1877727133103488:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:0.0:1790740417.429759:0:8460:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133103744 00000100:00100000:0.0:1790740417.429764:0:8460:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133103744 00000100:00100000:0.0:1790740417.429792:0:8460:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133103872 00000100:00100000:0.0:1790740417.429795:0:8460:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133103872 00000100:00100000:0.0:1790740417.429815:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 80 00000100:00100000:0.0:1790740417.429822:0:8460:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1b6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec599375-3198-45fd-a23a-c5620f07177c+5:2372:x1877727133103744:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:1.0:1790740417.429918:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1b6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+5:2372:x1877727133104000:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 574us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740417.429926:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 143 00000100:00100000:1.0:1790740417.429949:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 144 00000100:00100000:1.0:1790740417.429956:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1b6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+26:2372:x1877727133103616:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:3.0:1790740417.430084:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 81 00000100:00100000:3.0:1790740417.430093:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec599375-3198-45fd-a23a-c5620f07177c+7:2372:x1877727133103872:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:2.0:1790740417.430223:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:2372:x1877727133103488:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 578us (1163us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740417.430231:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 292 00000100:00080000:2.0:1790740417.430386:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790740417.430599:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790740417.430882:0:8460:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1b6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec599375-3198-45fd-a23a-c5620f07177c+5:2372:x1877727133103744:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 1057us (1772us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740417.430890:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 80 00000100:00100000:1.0:1790740417.431351:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1b6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+26:2372:x1877727133103616:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 1391us (2157us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740417.431360:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 144 00000100:00100000:3.0:1790740417.432189:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec599375-3198-45fd-a23a-c5620f07177c+7:2372:x1877727133103872:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 2093us (2971us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740417.432200:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 81 00010000:00010000:0.0:1790740417.854917:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740417.855279:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d98511180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158278016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790740417.855352:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740417.855452:0:6703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158278016 00000100:00100000:1.0:1790740417.855469:0:6703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158278016 00000100:00100000:1.0:1790740417.855515:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790740417.855524:0:6703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1877727158278016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790740417.855559:0:6703:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790740417.870829:0:6703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1877727158278016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 15293us (15464us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740417.870846:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1790740417.876812:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d98511180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158278016:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1790740418.436839:0:6725:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:0.0:1790740418.460364:0:5865:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967401 is committed 00000001:00080000:0.0:1790740418.460378:0:5865:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967411 is committed 00000020:00080000:0.0:1790740418.460455:0:5865:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000004:00080000:0.0:1790740418.460477:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:3.0:1790740418.460516:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000020:00080000:3.0:1790740418.460533:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000020:00080000:0.0:1790740418.461050:0:5865:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f0d9921b180 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1790740418.461056:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f0dc1371700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f0d9921b0c0 00000020:00080000:0.0:1790740418.461059:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f0dc1371300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f0db5791400 00000001:00080000:0.0:1790740418.461089:0:5865:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:2.0:1790740418.461143:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1790740418.461500:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:0.0:1790740418.461726:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbee2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158278144:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1790740418.462087:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740418.463650:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158278144 00000100:00100000:3.0:1790740418.463661:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158278144 00000100:00080000:1.0:1790740418.463720:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790740418.463741:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790740418.463753:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1877727158278144:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1790740418.463936:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1790740418.463940:0:6700:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1790740412 -> 1790740412 00002000:00010000:3.0:1790740418.463942:0:6700:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 1790740412 -> 1790740412 00002000:00010000:3.0:1790740418.463944:0:6700:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1790740412 -> 1790740412 00002000:00010000:3.0:1790740418.463946:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1790740418.464152:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3303:x1877727158278144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 401us (2064us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1790740418.464169:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000004:00080000:1.0:1790740418.464233:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f0dbee2ea00/2, rc 0, transno 4294967312 00000100:00100000:1.0:1790740418.464241:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbee2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158278144:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1790740418.864713:0:11661:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1790740418.918393:0:7642:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:0.0:1790740418.918435:0:7642:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:0.0:1790740418.918443:0:7642:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00010000:00010000:1.0:1790740419.892011:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740420.913169:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740421.936704:0:11661:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740421.936997:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790740421.937090:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877727158278400:0@lo:400:kworker.0 00000100:00100000:3.0:1790740421.937160:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740421.937214:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790740421.937219:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1877727158278528:0@lo:400:kworker.0 00000100:00100000:3.0:1790740421.937259:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740421.937293:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158278400 00000100:00100000:3.0:1790740421.937301:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158278400 00000100:00100000:3.0:1790740421.937337:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158278528 00000100:00100000:3.0:1790740421.937339:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158278528 00000100:00100000:3.0:1790740421.937363:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1790740421.937370:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d87e20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877727158278400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740421.937432:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d87e20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877727158278400:12345-0@lo:400:kworker.0 Request processed in 62us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740421.937440:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1790740421.937462:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1790740421.937468:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877727158278528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740421.937505:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877727158278528:12345-0@lo:400:kworker.0 Request processed in 37us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740421.937510:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1790740421.937552:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1877727158278528:0@lo:400:kworker.0 00000100:00100000:3.0:1790740421.937561:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877727158278400:0@lo:400:kworker.0 00000100:00100000:1.0:1790740421.937742:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790740421.937752:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158278656:0@lo:400:kworker.0 00000100:00100000:1.0:1790740421.937796:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790740421.937837:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790740421.937971:0:8460:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158278656 00000100:00100000:3.0:1790740421.937975:0:8460:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158278656 00000100:00100000:3.0:1790740421.938014:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1790740421.938021:0:8460:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158278656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740421.938053:0:8460:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158278656:12345-0@lo:400:kworker.0 Request processed in 33us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740421.938065:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:1.0:1790740421.939486:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790740421.939527:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1790740421.939534:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f0dbd7d7100, transno 4294967304 00000100:00100000:1.0:1790740421.939562:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158278656:0@lo:400:kworker.0 00000100:00100000:2.0:1790740421.943074:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158278912:0@lo:400:kworker.0 00000100:00100000:2.0:1790740421.943155:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740421.943679:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158278912 00000100:00100000:0.0:1790740421.943687:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158278912 00000100:00100000:0.0:1790740421.943754:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1790740421.943764:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d98511180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158278912:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1790740421.943855:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790740421.943955:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d98511180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158278912:12345-0@lo:400:kworker.0 Request processed in 193us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740421.943962:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1790740421.944059:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:2.0:1790740421.944064:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967311 committed transno 4294967312 00000004:00080000:2.0:1790740421.944084:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f0dbee2ea00, transno 4294967312 00000100:00100000:2.0:1790740421.944095:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158278912:0@lo:400:kworker.0 00000100:00100000:1.0:1790740421.944539:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1877727158278784:0@lo:400:kworker.0 00000100:00100000:1.0:1790740421.944745:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740421.946960:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3303:1877727158278272:0@lo:400:kworker.0 00000100:00100000:3.0:1790740421.947027:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740421.948980:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158278272 00000100:00100000:0.0:1790740421.948993:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158278272 00000100:00100000:0.0:1790740421.949062:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1790740421.949073:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3303:x1877727158278272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740421.949168:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3303:x1877727158278272:12345-0@lo:400:kworker.0 Request processed in 97us (2140us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740421.949175:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1790740421.949277:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3303:1877727158278272:0@lo:400:kworker.0 00000100:00100000:2.0:1790740421.950198:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158278784 00000100:00100000:2.0:1790740421.950206:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158278784 00000100:00100000:2.0:1790740421.950262:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1790740421.950269:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1877727158278784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740421.950326:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1877727158278784:12345-0@lo:400:kworker.0 Request processed in 57us (5580us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740421.950332:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:1.0:1790740421.950410:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790740421.950604:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1877727158278784:0@lo:400:kworker.0 00000100:00100000:2.0:1790740421.962948:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740421.963037:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133104128 00000100:00100000:3.0:1790740421.963047:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133104128 00000100:00100000:3.0:1790740421.963125:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 135 00000100:00100000:3.0:1790740421.963147:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc12ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+13:10233:x1877727133104128:12345-192.168.203.58@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1790740421.963253:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc12ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+13:10233:x1877727133104128:12345-192.168.203.58@tcp:60:lhsmtool_posix.0 Request processed in 118us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740421.963261:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 135 00000100:00080000:1.0:1790740421.963610:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790740421.971843:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740421.971999:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133104384 00000100:00100000:2.0:1790740421.972009:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133104384 00000100:00100000:2.0:1790740421.972069:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 35 00000100:00100000:2.0:1790740421.972079:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec599375-3198-45fd-a23a-c5620f07177c+13:10233:x1877727133104384:12345-192.168.203.58@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790740421.972435:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec599375-3198-45fd-a23a-c5620f07177c+14:10233:x1877727133104384:12345-192.168.203.58@tcp:35:lhsmtool_posix.0 Request processed in 356us (599us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1790740421.972443:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 35 00000100:00100000:3.0:1790740422.448914:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790740422.448938:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db6dc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158279040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790740422.449007:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740422.449603:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158279040 00000100:00100000:2.0:1790740422.449611:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158279040 00000100:00100000:2.0:1790740422.449666:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790740422.449676:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158279040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790740422.449712:0:6704:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790740422.449769:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158279040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740422.449776:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790740422.449984:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db6dc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158279040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790740422.544212:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740422.544303:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133104512 00000100:00100000:2.0:1790740422.544312:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133104512 00000100:00100000:2.0:1790740422.544369:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 294 00000100:00100000:2.0:1790740422.544379:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:2369:x1877727133104512:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:2.0:1790740422.544452:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:2369:x1877727133104512:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 74us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740422.544460:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 294 00000100:00100000:3.0:1790740422.545462:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740422.545544:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133104640 00000100:00100000:2.0:1790740422.545551:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133104640 00000100:00100000:2.0:1790740422.545622:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 148 00000100:00100000:2.0:1790740422.545631:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+14:2369:x1877727133104640:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:2.0:1790740422.545688:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+14:2369:x1877727133104640:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 59us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740422.545695:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 148 00000100:00100000:1.0:1790740422.552122:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740422.552184:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740422.552230:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740422.552437:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133104896 00000100:00100000:2.0:1790740422.552448:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133104896 00000100:00100000:2.0:1790740422.552511:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133104768 00000100:00100000:2.0:1790740422.552515:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133104768 00000100:00100000:2.0:1790740422.552541:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 84 00000100:00100000:2.0:1790740422.552552:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec599375-3198-45fd-a23a-c5620f07177c+6:2370:x1877727133104896:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:2.0:1790740422.552649:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec599375-3198-45fd-a23a-c5620f07177c+6:2370:x1877727133104896:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 99us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740422.552657:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 84 00000100:00100000:2.0:1790740422.552674:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 85 00000100:00100000:2.0:1790740422.552680:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1a40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec599375-3198-45fd-a23a-c5620f07177c+5:2370:x1877727133104768:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:2.0:1790740422.552707:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1a40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec599375-3198-45fd-a23a-c5620f07177c+5:2370:x1877727133104768:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 26us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740422.552714:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 85 00000100:00100000:0.0:1790740422.552816:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133105024 00000100:00100000:0.0:1790740422.552829:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133105024 00000100:00100000:0.0:1790740422.552864:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 149 00000100:00100000:0.0:1790740422.552874:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1a43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+5:2370:x1877727133105024:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:0.0:1790740422.552922:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1a43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+5:2370:x1877727133105024:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 51us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740422.552929:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 149 00000100:00080000:1.0:1790740422.553400:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790740422.553405:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790740422.553408:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:1.0:1790740422.768837:0:11679:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790740422.768846:0:11679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790740422.769154:0:11679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:1.0:1790740422.769160:0:11679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790740422.960919:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db6dc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158279168:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790740422.960991:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790740422.961275:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740422.961474:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158279168 00000100:00100000:2.0:1790740422.961482:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158279168 00000100:00100000:2.0:1790740422.961528:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1790740422.961537:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158279168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790740422.961593:0:6704:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790740422.961652:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158279168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740422.961660:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1790740422.961803:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db6dc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158279168:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1790740423.571972:0:5865:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:0.0:1790740423.571985:0:5865:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1790740423.572060:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1790740423.572069:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:02000400:1.0:1790740423.956870:0:12300:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 23:53:42 (1790740422) 00010000:00010000:3.0:1790740423.984733:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740425.008745:0:11661:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740425.418759:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740425.419104:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133105280 00000100:00100000:2.0:1790740425.419123:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133105280 00000100:00100000:2.0:1790740425.419216:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 136 00000100:00100000:2.0:1790740425.419244:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1a40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+13:11291:x1877727133105280:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790740425.419268:0:8666:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740425.419288:0:8666:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea54e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee5ff expref: -99 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740425.419371:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598ea555 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740425.419386:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598ea555 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740425.419400:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598ea555 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740425.419414:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea55c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740425.419420:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea55c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740425.419426:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea55c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740425.419684:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598ea563 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740425.419697:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598ea563 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740425.419704:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598ea563 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740425.419722:0:8666:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1790740425.419866:0:8666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598ea555 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740425.419874:0:8666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598ea555 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740425.419881:0:8666:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598ea555 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740425.419886:0:8666:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87595c00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740425.419891:0:8666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598ea555 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740425.419898:0:8666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598ea555 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740425.419911:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8f0d84a1e500) 00010000:00010000:2.0:1790740425.419914:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740425.419918:0:8666:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598ea555 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740425.419924:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598ea555 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740425.419936:0:8666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea55c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740425.419942:0:8666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea55c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740425.419959:0:8666:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea55c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740425.419964:0:8666:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87594200 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740425.419967:0:8666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea55c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740425.419973:0:8666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea55c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740425.419980:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8f0d98dcc300) 00010000:00010000:2.0:1790740425.419982:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740425.419985:0:8666:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea55c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740425.419991:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea55c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740425.420450:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea54e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5ff expref: 16 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740425.420467:0:8666:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598ea563 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5ff expref: 15 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740425.420474:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f0d944f6600) 00010000:00010000:2.0:1790740425.420476:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740425.420479:0:8666:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d87594000, rc 0) 00000100:00100000:2.0:1790740425.420548:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1a40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+15:11291:x1877727133105280:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 Request processed in 1309us (1797us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1790740425.420564:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 136 00000100:00080000:1.0:1790740425.421434:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790740425.433448:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740425.433494:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740425.433611:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133105408 00000100:00100000:1.0:1790740425.433620:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133105408 00000100:00100000:1.0:1790740425.433688:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 10 00000100:00100000:1.0:1790740425.433711:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d87402850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec599375-3198-45fd-a23a-c5620f07177c+15:2370:x1877727133105408:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790740425.433739:0:5830:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740425.433765:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598ea563 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5ff expref: 15 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740425.433785:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f0d944f6600) 00010000:00010000:1.0:1790740425.433791:0:5830:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740425.433844:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d87402850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec599375-3198-45fd-a23a-c5620f07177c+14:2370:x1877727133105408:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 145us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740425.433852:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 10 00000100:00100000:3.0:1790740425.433858:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133105536 00000100:00100000:3.0:1790740425.433873:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133105536 00000100:00100000:3.0:1790740425.433952:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 137 00000100:00100000:3.0:1790740425.433963:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db6dc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+14:11291:x1877727133105536:12345-192.168.203.58@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1790740425.434127:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db6dc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+14:11291:x1877727133105536:12345-192.168.203.58@tcp:59:lhsmtool_posix.0 Request processed in 164us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740425.434137:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 137 00000040:00080000:2.0:1790740425.847277:0:11679:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790740425.847285:0:11679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790740425.847324:0:11679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:2.0:1790740425.847332:0:11679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1790740426.033757:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740427.056772:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877727158279424:0@lo:400:kworker.0 00000100:00100000:0.0:1790740427.056839:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740427.056886:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158279936:0@lo:400:kworker.0 00000100:00100000:0.0:1790740427.056910:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740427.056939:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790740427.056944:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1877727158279552:0@lo:400:kworker.0 00000100:00100000:0.0:1790740427.056964:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740427.056992:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158279424 00000100:00100000:0.0:1790740427.057000:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158279424 00000100:00100000:0.0:1790740427.057039:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158279552 00000100:00100000:0.0:1790740427.057042:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158279552 00000100:00100000:0.0:1790740427.057071:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1790740427.057079:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877727158279424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740427.057137:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877727158279424:12345-0@lo:400:kworker.0 Request processed in 59us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740427.057144:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1790740427.057163:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1790740427.057169:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877727158279552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740427.057208:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877727158279552:12345-0@lo:400:kworker.0 Request processed in 39us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740427.057214:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1790740427.057233:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158279936 00000100:00100000:0.0:1790740427.057236:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158279936 00000100:00100000:0.0:1790740427.057261:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1790740427.057267:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158279936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740427.057293:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158279936:12345-0@lo:400:kworker.0 Request processed in 27us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740427.057299:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:0.0:1790740427.057319:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790740427.057324:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790740427.057355:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1877727158279552:0@lo:400:kworker.0 00000100:00100000:0.0:1790740427.057364:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877727158279424:0@lo:400:kworker.0 00000100:00100000:0.0:1790740427.057372:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158279936:0@lo:400:kworker.0 00000100:00100000:1.0:1790740427.057669:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3304:1877727158279296:0@lo:400:kworker.0 00000100:00100000:1.0:1790740427.057704:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740427.057866:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1877727158279808:0@lo:400:kworker.0 00000100:00100000:1.0:1790740427.057890:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740427.057907:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790740427.057914:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158279680:0@lo:400:kworker.0 00000100:00100000:1.0:1790740427.057938:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740427.057998:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158279680 00000100:00100000:1.0:1790740427.058002:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158279680 00000100:00100000:1.0:1790740427.058031:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1790740427.058037:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d84916300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158279680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740427.058074:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d84916300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158279680:12345-0@lo:400:kworker.0 Request processed in 37us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740427.058080:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00010000:1.0:1790740427.058108:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740427.058133:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158279680:0@lo:400:kworker.0 00000100:00100000:0.0:1790740427.058216:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158279296 00000100:00100000:0.0:1790740427.058220:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158279296 00000100:00100000:0.0:1790740427.058246:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1790740427.058252:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3304:x1877727158279296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740427.058286:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3304:x1877727158279296:12345-0@lo:400:kworker.0 Request processed in 34us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740427.058291:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00080000:0.0:1790740427.058311:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790740427.058325:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3304:1877727158279296:0@lo:400:kworker.0 00000100:00100000:0.0:1790740427.058343:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158279808 00000100:00100000:0.0:1790740427.058356:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158279808 00000100:00100000:0.0:1790740427.058383:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1790740427.058389:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1877727158279808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740427.058422:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1877727158279808:12345-0@lo:400:kworker.0 Request processed in 33us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740427.058428:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:0.0:1790740427.058444:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790740427.058460:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1877727158279808:0@lo:400:kworker.0 00000100:00100000:3.0:1790740427.221441:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740427.221539:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133105664 00000100:00100000:1.0:1790740427.221549:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133105664 00000100:00100000:1.0:1790740427.221831:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 138 00000100:00100000:1.0:1790740427.221842:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+14:11334:x1877727133105664:12345-192.168.203.58@tcp:101:lfs.0 00010000:00010000:1.0:1790740427.221865:0:5843:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740427.221887:0:5843:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea571 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee606 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.221950:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598ea578 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.221979:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598ea578 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.221992:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598ea578 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.222007:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea57f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.222015:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea57f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.222022:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea57f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1790740427.222190:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790740427.222540:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598ea578 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.222550:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598ea578 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.222558:0:5843:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598ea578 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.222564:0:5843:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f977000 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1790740427.222570:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598ea578 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.222608:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598ea578 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.223534:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0d944f6d00) 00010000:00010000:1.0:1790740427.223552:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740427.223559:0:5843:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598ea578 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.223568:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598ea578 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.223762:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea57f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.223770:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea57f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.223777:0:5843:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea57f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.223783:0:5843:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f976600 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1790740427.223787:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea57f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.223794:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea57f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.223804:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8f0d84a1e300) 00010000:00010000:1.0:1790740427.223807:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740427.223811:0:5843:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea57f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.223817:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea57f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.223865:0:5843:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea571 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee606 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.223889:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0d944f6d00) 00010000:00010000:1.0:1790740427.223891:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740427.223895:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea571 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee606 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.223907:0:5843:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9f977800, rc 0) 00000100:00100000:1.0:1790740427.223988:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+14:11334:x1877727133105664:12345-192.168.203.58@tcp:101:lfs.0 Request processed in 2147us (2556us total) trans 0 rc 301/301 00000100:00100000:1.0:1790740427.223997:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 138 00000100:00100000:2.0:1790740427.232389:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740427.237874:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133105920 00000100:00100000:1.0:1790740427.237890:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133105920 00000100:00100000:1.0:1790740427.237954:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 139 00000100:00100000:1.0:1790740427.237964:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd03d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+14:11334:x1877727133105920:12345-192.168.203.58@tcp:36:lfs.0 00010000:00010000:1.0:1790740427.238023:0:5844:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740427.238050:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fe00/0xc6b31a1b598e9efd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee446 expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.238073:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0d944f6d00) 00010000:00010000:1.0:1790740427.238084:0:5844:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790740427.238426:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea586 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.238442:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea586 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.238453:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea586 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.238474:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031200/0xc6b31a1b598ea58d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.238555:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031200/0xc6b31a1b598ea58d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.238565:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031200/0xc6b31a1b598ea58d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790740427.239993:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1790740427.240009:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea586 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.240018:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea586 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.240026:0:5844:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea586 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.240032:0:5844:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f976000 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1790740427.240037:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea586 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.240045:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea586 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.240058:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0d84a1e100) 00010000:00010000:1.0:1790740427.240061:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740427.240066:0:5844:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea586 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.240084:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea586 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790740427.240119:0:5844:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000065945007 reply state 000000008b66ac60 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031200/0xc6b31a1b598ea58d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740427.240129:0:5844:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790740427.240421:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd03d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+15:11334:x1877727133105920:12345-192.168.203.58@tcp:36:lfs.0 Request processed in 2258us (7842us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1790740427.240432:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 139 00010000:00010000:1.0:1790740427.248600:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031200/0xc6b31a1b598ea58d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.248629:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031200/0xc6b31a1b598ea58d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.248639:0:3290:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031200/0xc6b31a1b598ea58d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.248646:0:3290:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d80031200 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1790740427.248652:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031200/0xc6b31a1b598ea58d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.248661:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031200/0xc6b31a1b598ea58d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.248678:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8f0d84a1e900) 00010000:00010000:1.0:1790740427.248682:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740427.248688:0:3290:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031200/0xc6b31a1b598ea58d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.248706:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031200/0xc6b31a1b598ea58d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740427.353482:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740427.353559:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133106048 00000100:00100000:3.0:1790740427.353607:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133106048 00000100:00100000:3.0:1790740427.353675:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 140 00000100:00100000:3.0:1790740427.353686:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1694a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+14:11342:x1877727133106048:12345-192.168.203.58@tcp:101:lctl.0 00010000:00010000:3.0:1790740427.353709:0:5842:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740427.354920:0:5842:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598ea594 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee60d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740427.355370:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594600/0xc6b31a1b598ea59b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740427.355386:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594600/0xc6b31a1b598ea59b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740427.355398:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594600/0xc6b31a1b598ea59b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740427.355431:0:5842:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790740427.355435:0:5842:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790740427.355459:0:5842:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594600/0xc6b31a1b598ea59b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740427.355486:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598ea594 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee60d expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740427.355622:0:5842:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594600/0xc6b31a1b598ea59b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee60d expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740427.355632:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0d98dcc200) 00010000:00010000:2.0:1790740427.355635:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790740427.355640:0:5842:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d87594600, rc 0) 00000100:00100000:2.0:1790740427.355720:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1694a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+15:11342:x1877727133106048:12345-192.168.203.58@tcp:101:lctl.0 Request processed in 2035us (2255us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740427.355730:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 140 00000100:00100000:0.0:1790740427.450027:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740427.450300:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133106176 00000100:00100000:2.0:1790740427.450310:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133106176 00000100:00100000:2.0:1790740427.450381:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 141 00000100:00100000:2.0:1790740427.450391:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+15:11348:x1877727133106176:12345-192.168.203.58@tcp:101:bash.0 00010000:00010000:2.0:1790740427.450412:0:8666:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740427.450433:0:8666:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598ea5a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee614 expref: -99 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740427.450499:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598ea5a9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740427.450513:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598ea5a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740427.450525:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598ea5a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740427.450541:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595600/0xc6b31a1b598ea5b0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740427.450559:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595600/0xc6b31a1b598ea5b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740427.450566:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595600/0xc6b31a1b598ea5b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740427.450960:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595200/0xc6b31a1b598ea5b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740427.450969:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595200/0xc6b31a1b598ea5b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740427.450976:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595200/0xc6b31a1b598ea5b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740427.451002:0:8666:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1790740427.451006:0:8666:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790740427.451026:0:8666:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595200/0xc6b31a1b598ea5b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740427.451037:0:8666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598ea5a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740427.451045:0:8666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598ea5a9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740427.451052:0:8666:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598ea5a9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740427.451058:0:8666:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87594a00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740427.451062:0:8666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598ea5a9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740427.451079:0:8666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598ea5a9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740427.451104:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0d98dcc200) 00010000:00010000:2.0:1790740427.451107:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740427.451113:0:8666:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598ea5a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740427.451120:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598ea5a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740427.451134:0:8666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595600/0xc6b31a1b598ea5b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740427.451141:0:8666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595600/0xc6b31a1b598ea5b0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740427.451147:0:8666:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595600/0xc6b31a1b598ea5b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740427.451153:0:8666:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87595600 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740427.451156:0:8666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595600/0xc6b31a1b598ea5b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740427.451162:0:8666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595600/0xc6b31a1b598ea5b0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740427.451169:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8f0d98dcc900) 00010000:00010000:2.0:1790740427.451172:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740427.451174:0:8666:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595600/0xc6b31a1b598ea5b0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740427.451190:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595600/0xc6b31a1b598ea5b0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740427.451225:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598ea5a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee614 expref: 17 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740427.451239:0:8666:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595200/0xc6b31a1b598ea5b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee614 expref: 16 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740427.451247:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f0d98dccd00) 00010000:00010000:2.0:1790740427.451249:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1790740427.451252:0:8666:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d87595200, rc 0) 00000100:00100000:2.0:1790740427.452971:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+16:11348:x1877727133106176:12345-192.168.203.58@tcp:101:bash.0 Request processed in 2574us (2944us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740427.452982:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 141 00000100:00100000:2.0:1790740427.467752:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740427.467968:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133106432 00000100:00100000:1.0:1790740427.467978:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133106432 00000100:00100000:1.0:1790740427.468033:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 142 00000100:00100000:1.0:1790740427.468044:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8654a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+16:11348:x1877727133106432:12345-192.168.203.58@tcp:101:bash.0 00010000:00010000:1.0:1790740427.468063:0:5843:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740427.468083:0:5843:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031600/0xc6b31a1b598ea5be lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee61b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.468212:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030600/0xc6b31a1b598ea5c5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.468226:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030600/0xc6b31a1b598ea5c5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.468237:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030600/0xc6b31a1b598ea5c5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.468306:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030a00/0xc6b31a1b598ea5cc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.468326:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030a00/0xc6b31a1b598ea5cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.468334:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030a00/0xc6b31a1b598ea5cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790740427.469187:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:1.0:1790740427.469793:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030c00/0xc6b31a1b598ea5d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.469809:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030c00/0xc6b31a1b598ea5d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.469818:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030c00/0xc6b31a1b598ea5d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.469852:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030600/0xc6b31a1b598ea5c5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.469860:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030600/0xc6b31a1b598ea5c5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.469866:0:5843:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030600/0xc6b31a1b598ea5c5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.469872:0:5843:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d80030600 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1790740427.469876:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030600/0xc6b31a1b598ea5c5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.469882:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030600/0xc6b31a1b598ea5c5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.469894:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f0d98dccd00) 00010000:00010000:1.0:1790740427.469897:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740427.469901:0:5843:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030600/0xc6b31a1b598ea5c5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.469907:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030600/0xc6b31a1b598ea5c5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790740427.469933:0:5843:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000d5c62b41 reply state 00000000b2a610be transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030a00/0xc6b31a1b598ea5cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740427.469941:0:5843:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790740427.469975:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031600/0xc6b31a1b598ea5be lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee61b expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.469990:0:5843:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030c00/0xc6b31a1b598ea5d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee61b expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.469997:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f0d84a1e100) 00010000:00010000:1.0:1790740427.470000:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790740427.470002:0:5843:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d80030c00, rc 0) 00000100:00100000:1.0:1790740427.470126:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8654a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+19:11348:x1877727133106432:12345-192.168.203.58@tcp:101:bash.0 Request processed in 2083us (2382us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1790740427.470135:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 142 00000100:00100000:1.0:1790740427.478074:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740427.478542:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133106560 00000100:00100000:3.0:1790740427.478552:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133106560 00000100:00080000:2.0:1790740427.478759:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790740427.479003:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 47 00000100:00100000:2.0:1790740427.479016:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d84917480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec599375-3198-45fd-a23a-c5620f07177c+5:2372:x1877727133106560:12345-192.168.203.58@tcp:101:bash.0 00010000:00010000:2.0:1790740427.479034:0:6700:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740427.479055:0:6700:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004ba155b/0xc6b31a1b598ea5e1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee622 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790740427.479082:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790740427.479112:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=343s v=(0 0) 00010000:00010000:2.0:1790740427.479117:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790740427.479138:0:6700:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004ba155b/0xc6b31a1b598ea5e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee622 expref: 6 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740427.479159:0:6700:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000004ba155b/0xc6b31a1b598ea5e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee622 expref: 6 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740427.479173:0:6700:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d87594400, rc 0) 00000100:00100000:2.0:1790740427.479237:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d84917480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec599375-3198-45fd-a23a-c5620f07177c+6:2372:x1877727133106560:12345-192.168.203.58@tcp:101:bash.0 Request processed in 224us (1173us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740427.479245:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 47 00010000:00010000:0.0:1790740427.479362:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030a00/0xc6b31a1b598ea5cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740427.479372:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030a00/0xc6b31a1b598ea5cc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740427.479380:0:3289:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030a00/0xc6b31a1b598ea5cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740427.479386:0:3289:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d80030a00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1790740427.479390:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030a00/0xc6b31a1b598ea5cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740427.479399:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030a00/0xc6b31a1b598ea5cc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740427.479413:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8f0d84a1e900) 00010000:00010000:0.0:1790740427.479416:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740427.479421:0:3289:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030a00/0xc6b31a1b598ea5cc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740427.479438:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030a00/0xc6b31a1b598ea5cc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740427.489112:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740427.489207:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133106688 00000100:00100000:1.0:1790740427.489218:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133106688 00000100:00100000:1.0:1790740427.489278:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 48 00000100:00100000:1.0:1790740427.489288:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec599375-3198-45fd-a23a-c5620f07177c+6:11348:x1877727133106688:12345-192.168.203.58@tcp:101:bash.0 00010000:00010000:1.0:1790740427.489306:0:6701:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740427.489335:0:6701:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c88b8b43/0xc6b31a1b598ea5e8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee629 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.489370:0:6701:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000004ba155b/0xc6b31a1b598ea5e1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee622 expref: 7 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.489400:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790740427.489405:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790740427.489411:0:6701:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c88b8b43/0xc6b31a1b598ea5e8 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee629 expref: 7 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.489446:0:6701:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000004ba155b/0xc6b31a1b598ea5e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee622 expref: 7 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.489459:0:6701:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000004ba155b/0xc6b31a1b598ea5e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee622 expref: 7 pid: 6700 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740427.489474:0:6701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc12ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6701:1877727158280064:192.168.203.58@tcp:104: 00000100:00100000:1.0:1790740427.490022:0:6701:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d9921b600 going to sleep for 11 seconds 00000100:00100000:1.0:1790740427.493325:0:6701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc12ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6701:1877727158280064:192.168.203.58@tcp:104: 00010000:00010000:1.0:1790740427.493362:0:6701:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c88b8b43/0xc6b31a1b598ea5e8 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee629 expref: 7 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.493382:0:6701:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d80031600, rc 0) 00000100:00100000:1.0:1790740427.493488:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec599375-3198-45fd-a23a-c5620f07177c+7:11348:x1877727133106688:12345-192.168.203.58@tcp:101:bash.0 Request processed in 4201us (4397us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740427.493498:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 48 00000100:00100000:1.0:1790740427.494555:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740427.494718:0:8506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133106816 00000100:00100000:3.0:1790740427.494737:0:8506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133106816 00010000:00010000:3.0:1790740427.495475:0:8506:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000004ba155b/0xc6b31a1b598ea5e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee622 expref: 7 pid: 6700 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740427.495528:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 59 00000100:00100000:3.0:1790740427.495541:0:8506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc12ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec599375-3198-45fd-a23a-c5620f07177c+7:2370:x1877727133106816:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790740427.495558:0:8506:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740427.495627:0:8506:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000004ba155b/0xc6b31a1b598ea5e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee622 expref: 7 pid: 6700 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740427.495641:0:8506:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000004ba155b/0xc6b31a1b598ea5e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee622 expref: 7 pid: 6700 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740427.495663:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004ba155b/0xc6b31a1b598ea5e1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee622 expref: 7 pid: 6700 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740427.495696:0:8506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790740427.495701:0:8506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790740427.495710:0:8506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c88b8b43/0xc6b31a1b598ea5e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee629 expref: 6 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740427.495720:0:8506:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c88b8b43/0xc6b31a1b598ea5e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee629 expref: 6 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740427.495760:0:8506:0:(ldlm_lockd.c:1085:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c88b8b43/0xc6b31a1b598ea5e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee629 expref: 6 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740427.495775:0:8506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbee5fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8506:1877727158280192:192.168.203.58@tcp:105: 00000100:00100000:3.0:1790740427.495866:0:8506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d85cd0840 going to sleep for 11 seconds 00000100:00100000:3.0:1790740427.501140:0:8506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbee5fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8506:1877727158280192:192.168.203.58@tcp:105: 00010000:00010000:3.0:1790740427.501171:0:8506:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790740427.501274:0:8506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc12ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec599375-3198-45fd-a23a-c5620f07177c+6:2370:x1877727133106816:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 5736us (6722us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740427.501285:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 59 00000100:00100000:1.0:1790740427.503877:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740427.503970:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133107072 00000100:00100000:2.0:1790740427.503981:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133107072 00000100:00100000:2.0:1790740427.504075:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 36 00000100:00100000:2.0:1790740427.504086:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc12ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec599375-3198-45fd-a23a-c5620f07177c+18:11348:x1877727133107072:12345-192.168.203.58@tcp:35:bash.0 00000100:00100000:2.0:1790740427.504439:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc12ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec599375-3198-45fd-a23a-c5620f07177c+19:11348:x1877727133107072:12345-192.168.203.58@tcp:35:bash.0 Request processed in 354us (568us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1790740427.504448:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 36 00000100:00100000:0.0:1790740427.569112:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1c3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158280320:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790740427.569187:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740427.569603:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158280320 00000100:00100000:2.0:1790740427.569612:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158280320 00000100:00100000:2.0:1790740427.569657:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1790740427.569666:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877727158280320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790740427.569700:0:6704:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790740427.569753:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877727158280320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740427.569761:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1790740427.569877:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1c3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158280320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790740427.615700:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740427.616182:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133107328 00000100:00100000:0.0:1790740427.616196:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133107328 00000100:00100000:0.0:1790740427.616476:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 143 00000100:00100000:0.0:1790740427.616489:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d87e23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+19:11358:x1877727133107328:12345-192.168.203.58@tcp:101:lfs.0 00010000:00010000:0.0:1790740427.616515:0:5844:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740427.616536:0:5844:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e200/0xc6b31a1b598ea5ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee630 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790740427.616666:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1790740427.616790:0:5844:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e200/0xc6b31a1b598ea5ef lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee630 expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740427.616804:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0d98dcc200) 00010000:00010000:0.0:1790740427.616807:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790740427.616812:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e200/0xc6b31a1b598ea5ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee630 expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740427.616825:0:5844:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0dc132e200, rc 0) 00000100:00100000:0.0:1790740427.616878:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d87e23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+20:11358:x1877727133107328:12345-192.168.203.58@tcp:101:lfs.0 Request processed in 392us (1187us total) trans 4294967419 rc 301/301 00000100:00100000:0.0:1790740427.619874:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 143 00000100:00100000:0.0:1790740427.624834:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740427.625057:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133107584 00000100:00100000:1.0:1790740427.625066:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133107584 00000100:00100000:1.0:1790740427.625186:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 37 00000100:00100000:1.0:1790740427.625195:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+20:11358:x1877727133107584:12345-192.168.203.58@tcp:35:lfs.0 00000100:00100000:1.0:1790740427.628877:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+21:11358:x1877727133107584:12345-192.168.203.58@tcp:35:lfs.0 Request processed in 3673us (4042us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1790740427.628901:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 37 00000100:00100000:1.0:1790740427.663966:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740427.664032:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740427.664078:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740427.664177:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133107712 00000100:00100000:0.0:1790740427.664187:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133107712 00000100:00100000:0.0:1790740427.664241:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 296 00000100:00100000:0.0:1790740427.664251:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:2370:x1877727133107712:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:0.0:1790740427.664324:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:2370:x1877727133107712:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 75us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740427.664332:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 296 00000100:00100000:3.0:1790740427.664504:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133107840 00000100:00100000:3.0:1790740427.664509:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133107840 00000100:00100000:3.0:1790740427.664560:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 88 00000100:00100000:3.0:1790740427.664569:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec599375-3198-45fd-a23a-c5620f07177c+6:2370:x1877727133107840:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:3.0:1790740427.664645:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec599375-3198-45fd-a23a-c5620f07177c+6:2370:x1877727133107840:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 78us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740427.664663:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 88 00000100:00100000:2.0:1790740427.664769:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133107968 00000100:00100000:2.0:1790740427.664780:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133107968 00000100:00100000:2.0:1790740427.664820:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 153 00000100:00100000:2.0:1790740427.664828:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+5:2370:x1877727133107968:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:2.0:1790740427.664863:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+5:2370:x1877727133107968:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 36us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740427.664869:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 153 00000100:00080000:0.0:1790740427.665429:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790740427.665435:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790740427.729742:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740427.729875:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133108096 00000100:00100000:3.0:1790740427.729885:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133108096 00000100:00100000:3.0:1790740427.729938:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 144 00000100:00100000:3.0:1790740427.729948:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+21:11364:x1877727133108096:12345-192.168.203.58@tcp:101:lfs.0 00010000:00010000:3.0:1790740427.729973:0:8666:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740427.729993:0:8666:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fa00/0xc6b31a1b598ea5fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee637 expref: -99 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740427.730061:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f400/0xc6b31a1b598ea604 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740427.730075:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f400/0xc6b31a1b598ea604 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740427.730087:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f400/0xc6b31a1b598ea604 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790740427.730133:0:8666:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1790740427.730137:0:8666:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790740427.730153:0:8666:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f400/0xc6b31a1b598ea604 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740427.730177:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fa00/0xc6b31a1b598ea5fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee637 expref: 23 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740427.730195:0:8666:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f400/0xc6b31a1b598ea604 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee637 expref: 22 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740427.730223:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f0d98dccd00) 00010000:00010000:3.0:1790740427.730226:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790740427.730230:0:8666:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0db6c0f400, rc 0) 00000100:00100000:3.0:1790740427.730293:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+22:11364:x1877727133108096:12345-192.168.203.58@tcp:101:lfs.0 Request processed in 347us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740427.730300:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 144 00000100:00100000:1.0:1790740427.734188:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740427.734380:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133108352 00000100:00100000:2.0:1790740427.734390:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133108352 00000100:00100000:2.0:1790740427.734441:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 145 00000100:00100000:2.0:1790740427.734450:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+22:11364:x1877727133108352:12345-192.168.203.58@tcp:101:lfs.0 00010000:00010000:2.0:1790740427.734467:0:5842:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740427.734485:0:5842:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598ea60b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee63e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740427.734601:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598ea612 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740427.734614:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598ea612 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740427.734634:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598ea612 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740427.734644:0:5842:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1790740427.734802:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598ea60b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee63e expref: 25 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740427.734821:0:5842:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598ea612 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee63e expref: 24 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740427.734849:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f0d84a1e100) 00010000:00010000:2.0:1790740427.734853:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790740427.734856:0:5842:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d87595400, rc 0) 00000100:00100000:2.0:1790740427.734923:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+24:11364:x1877727133108352:12345-192.168.203.58@tcp:101:lfs.0 Request processed in 473us (743us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1790740427.734930:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 145 00000100:00100000:1.0:1790740427.737974:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740427.738088:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133108608 00000100:00100000:3.0:1790740427.738108:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133108608 00000100:00100000:3.0:1790740427.738164:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 146 00000100:00100000:3.0:1790740427.738173:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+24:11364:x1877727133108608:12345-192.168.203.58@tcp:101:lfs.0 00010000:00010000:3.0:1790740427.738199:0:8666:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740427.738220:0:8666:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fe00/0xc6b31a1b598ea620 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee645 expref: -99 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740427.738314:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ec00/0xc6b31a1b598ea627 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740427.738329:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ec00/0xc6b31a1b598ea627 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740427.738340:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ec00/0xc6b31a1b598ea627 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790740427.738352:0:8666:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1790740427.738465:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fe00/0xc6b31a1b598ea620 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee645 expref: 27 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740427.738501:0:8666:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ec00/0xc6b31a1b598ea627 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee645 expref: 26 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740427.738509:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f0d84a1e100) 00010000:00010000:3.0:1790740427.738512:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1790740427.738515:0:8666:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0db6c0ec00, rc 0) 00000100:00100000:3.0:1790740427.738602:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+26:11364:x1877727133108608:12345-192.168.203.58@tcp:101:lfs.0 Request processed in 430us (637us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1790740427.738610:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 146 00000100:00100000:1.0:1790740427.740608:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740427.740831:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133108736 00000100:00100000:2.0:1790740427.740841:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133108736 00000100:00100000:2.0:1790740427.740905:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 11 00000100:00100000:2.0:1790740427.740915:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec599375-3198-45fd-a23a-c5620f07177c+26:2372:x1877727133108736:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790740427.740930:0:5830:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740427.740952:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598ea612 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee63e expref: 26 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740427.740969:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f0d84a1e100) 00010000:00010000:2.0:1790740427.740974:0:5830:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790740427.741026:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec599375-3198-45fd-a23a-c5620f07177c+25:2372:x1877727133108736:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 112us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740427.741033:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 11 00000100:00100000:1.0:1790740427.747934:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740427.748012:0:8460:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133108864 00000100:00100000:3.0:1790740427.748021:0:8460:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133108864 00000100:00100000:3.0:1790740427.748076:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 49 00000100:00100000:3.0:1790740427.748086:0:8460:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec599375-3198-45fd-a23a-c5620f07177c+6:2370:x1877727133108864:12345-192.168.203.58@tcp:1:lfs.0 00010000:00010000:3.0:1790740427.748141:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008da15ad3/0xc6b31a1b598ea635 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740427.748162:0:8460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c88b8b43/0xc6b31a1b598ea5e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee629 expref: 6 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740427.748171:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790740427.748175:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790740427.748180:0:8460:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008da15ad3/0xc6b31a1b598ea635 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740427.748214:0:8460:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c88b8b43/0xc6b31a1b598ea5e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee629 expref: 6 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740427.748240:0:8460:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c88b8b43/0xc6b31a1b598ea5e8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee629 expref: 6 pid: 6701 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740427.748255:0:8460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbee5fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8460:1877727158280448:192.168.203.58@tcp:104: 00000100:00100000:3.0:1790740427.748342:0:8460:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d85cd0840 going to sleep for 11 seconds 00000100:00100000:3.0:1790740427.752842:0:8460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbee5fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8460:1877727158280448:192.168.203.58@tcp:104: 00010000:00010000:3.0:1790740427.752875:0:8460:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008da15ad3/0xc6b31a1b598ea635 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740427.754884:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740427.754981:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133108992 00000100:00100000:2.0:1790740427.754990:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133108992 00002000:00100000:2.0:1790740427.755040:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8f0dbda74000 x1877727133108992/t0(0) o4->ec599375-3198-45fd-a23a-c5620f07177c@192.168.203.58@tcp:483/0 lens 504/0 e 0 to 0 dl 1790740438 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790740427.755051:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f0dbda74000 with x1877727133108992 ext(0->12) 00010000:00010000:2.0:1790740427.755060:0:6706:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c88b8b43/0xc6b31a1b598ea5e8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee629 expref: 7 pid: 6701 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740427.755100:0:6706:0:(ldlm_lockd.c:610:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c88b8b43/0xc6b31a1b598ea5e8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee629 expref: 7 pid: 6701 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790740427.755110:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8f0dbda74000 00000100:00100000:2.0:1790740427.755181:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 2 00000100:00100000:2.0:1790740427.755190:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ec599375-3198-45fd-a23a-c5620f07177c+7:2370:x1877727133108992:12345-192.168.203.58@tcp:4:lfs.0 00000100:00100000:2.0:1790740427.755746:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ec599375-3198-45fd-a23a-c5620f07177c+9:2370:x1877727133108992:12345-192.168.203.58@tcp:4:lfs.0 Request processed in 555us (866us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1790740427.755753:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 2 00002000:00100000:2.0:1790740427.755761:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8f0dbda74000 x1877727133108992/t4294967305(0) o4->ec599375-3198-45fd-a23a-c5620f07177c@192.168.203.58@tcp:483/0 lens 504/448 e 0 to 0 dl 1790740438 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790740427.755769:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f0dbda74000 with x1877727133108992 ext(0->12) 00010000:00010000:2.0:1790740427.755775:0:6706:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c88b8b43/0xc6b31a1b598ea5e8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee629 expref: 9 pid: 6701 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740427.755788:0:6706:0:(ldlm_lockd.c:610:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c88b8b43/0xc6b31a1b598ea5e8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee629 expref: 9 pid: 6701 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790740427.755795:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8f0dbda74000 00000100:00100000:1.0:1790740427.765249:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740427.766390:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133109120 00000100:00100000:0.0:1790740427.766403:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133109120 00010000:00010000:0.0:1790740427.766448:0:5829:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c88b8b43/0xc6b31a1b598ea5e8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee629 expref: 9 pid: 6701 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740427.766494:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 60 00000100:00100000:0.0:1790740427.766504:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec599375-3198-45fd-a23a-c5620f07177c+9:2372:x1877727133109120:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790740427.766519:0:5829:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1790740427.766536:0:5829:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1790740427.766539:0:5829:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1790740427 00002000:00010000:0.0:1790740427.766541:0:5829:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1790740427 00002000:00010000:0.0:1790740427.766543:0:5829:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1790740427 00010000:00010000:0.0:1790740427.766549:0:5829:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c88b8b43/0xc6b31a1b598ea5e8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee629 expref: 9 pid: 6701 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740427.766638:0:5829:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c88b8b43/0xc6b31a1b598ea5e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee629 expref: 9 pid: 6701 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740427.766662:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c88b8b43/0xc6b31a1b598ea5e8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee629 expref: 9 pid: 6701 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740427.766682:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790740427.766686:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790740427.766692:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008da15ad3/0xc6b31a1b598ea635 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740427.766702:0:5829:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008da15ad3/0xc6b31a1b598ea635 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740427.766728:0:5829:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740427.766789:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec599375-3198-45fd-a23a-c5620f07177c+8:2372:x1877727133109120:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 287us (1549us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740427.766797:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 60 00010000:00010000:1.0:1790740427.766896:0:8460:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008da15ad3/0xc6b31a1b598ea635 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.766906:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008da15ad3/0xc6b31a1b598ea635 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.766934:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008da15ad3/0xc6b31a1b598ea635 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.766942:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008da15ad3/0xc6b31a1b598ea635 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.766963:0:8460:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008da15ad3/0xc6b31a1b598ea635 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.766970:0:8460:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0fa00 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:1.0:1790740427.766974:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008da15ad3/0xc6b31a1b598ea635 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.766982:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008da15ad3/0xc6b31a1b598ea635 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.766995:0:8460:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008da15ad3/0xc6b31a1b598ea635 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.767003:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008da15ad3/0xc6b31a1b598ea635 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740427.767052:0:8460:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec599375-3198-45fd-a23a-c5620f07177c+7:2370:x1877727133108864:12345-192.168.203.58@tcp:1:lfs.0 Request processed in 18967us (19127us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740427.767060:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 49 00000100:00100000:0.0:1790740427.774022:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740427.774194:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133109376 00000100:00100000:2.0:1790740427.774204:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133109376 00000100:00100000:2.0:1790740427.774264:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 38 00000100:00100000:2.0:1790740427.774275:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0da2038850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec599375-3198-45fd-a23a-c5620f07177c+25:11364:x1877727133109376:12345-192.168.203.58@tcp:35:lfs.0 00000004:00010000:2.0:1790740427.774355:0:5845:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ec00/0xc6b31a1b598ea627 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee645 expref: 25 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790740427.775108:0:5845:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:2.0:1790740427.775157:0:5845:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1790740427.776338:0:5845:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:2.0:1790740427.776408:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598ea63c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740427.776428:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030c00/0xc6b31a1b598ea5d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee61b expref: 29 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740427.776437:0:5845:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598ea63c lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740427.776486:0:5845:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030c00/0xc6b31a1b598ea5d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee61b expref: 29 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740427.776871:0:5845:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030c00/0xc6b31a1b598ea5d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee61b expref: 29 pid: 5843 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740427.776889:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1c3d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5845:1877727158280576:192.168.203.58@tcp:104: 00000100:00100000:2.0:1790740427.776997:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d81324b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790740427.786129:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740427.786711:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133109504 00000100:00100000:1.0:1790740427.786721:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133109504 00010000:00010000:1.0:1790740427.786765:0:5830:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030c00/0xc6b31a1b598ea5d3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee61b expref: 30 pid: 5843 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740427.786819:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 61 00000100:00100000:1.0:1790740427.786843:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec599375-3198-45fd-a23a-c5620f07177c+30:2370:x1877727133109504:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790740427.786859:0:5830:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740427.786867:0:5830:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030c00/0xc6b31a1b598ea5d3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee61b expref: 30 pid: 5843 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.786880:0:5830:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030c00/0xc6b31a1b598ea5d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee61b expref: 30 pid: 5843 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.786901:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f0d84a1e100) 00010000:00010000:1.0:1790740427.786907:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598ea63c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.786916:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598ea63c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.786924:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598ea63c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.786943:0:5830:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740427.787003:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec599375-3198-45fd-a23a-c5620f07177c+30:2370:x1877727133109504:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 161us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740427.787011:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 61 00010000:00010000:0.0:1790740427.795896:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030c00/0xc6b31a1b598ea5d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee61b expref: 29 pid: 5843 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740427.795922:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1c3d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5845:1877727158280576:192.168.203.58@tcp:104: 00010000:00010000:0.0:1790740427.796012:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598ea63c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740427.796043:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598ea63c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740427.796050:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598ea63c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790740427.796201:0:5845:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1790740427.796401:0:5845:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:0.0:1790740427.796506:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda42d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1877727158280704:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1790740427.796566:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740427.796783:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d8653d600 going to sleep for 11 seconds 00000100:00100000:3.0:1790740427.797543:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158280704 00000100:00100000:3.0:1790740427.797553:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158280704 00000100:00100000:3.0:1790740427.797868:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790740427.797879:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5845:x1877727158280704:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1790740427.798006:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5845:x1877727158280704:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 128us (1438us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740427.798014:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790740427.798110:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda42d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1877727158280704:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1790740427.798619:0:5845:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1790740427.798708:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1c3d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1877727158280832:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1790740427.798759:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740427.813656:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d813243c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790740427.813926:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158280832 00000100:00100000:0.0:1790740427.813936:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158280832 00000100:00100000:1.0:1790740427.814142:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790740427.814153:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db5a6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1877727158280832:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1790740427.815414:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db5a6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5845:x1877727158280832:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 1260us (16651us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1790740427.815425:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790740427.818864:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1c3d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1877727158280832:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1790740427.819064:0:5845:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:1.0:1790740427.819179:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598ea63c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.819192:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598ea63c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.819200:0:5845:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598ea63c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.819206:0:5845:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87594a00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1790740427.819211:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598ea63c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.819220:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598ea63c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.819237:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f0d84a1e100) 00010000:00010000:1.0:1790740427.819240:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1790740427.819246:0:5845:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598ea63c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740427.819252:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598ea63c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790740427.819493:0:5845:0:(mdd_object.c:4180:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1790740427.819926:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:1.0:1790740427.819951:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 343770377528ns, next at 344770375092ns, rc = 0 00000001:00080000:1.0:1790740427.819959:0:5845:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:1.0:1790740427.819997:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f0d84a1e100) 00010000:00010000:1.0:1790740427.820001:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1790740427.820008:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ec00/0xc6b31a1b598ea627 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee645 expref: 33 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740427.820157:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0da2038850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec599375-3198-45fd-a23a-c5620f07177c+32:11364:x1877727133109376:12345-192.168.203.58@tcp:35:lfs.0 Request processed in 45882us (46144us total) trans 4294967431 rc 0/0 00000100:00100000:1.0:1790740427.820165:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 38 00000020:00080000:1.0:1790740427.820171:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1790740427.826017:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740427.826116:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133109632 00000100:00100000:0.0:1790740427.826126:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133109632 00000100:00100000:0.0:1790740427.826184:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 147 00000100:00100000:0.0:1790740427.826193:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db5a69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+32:11364:x1877727133109632:12345-192.168.203.58@tcp:101:lfs.0 00010000:00010000:0.0:1790740427.826218:0:5842:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740427.826240:0:5842:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fc00/0xc6b31a1b598ea643 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee64c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740427.826306:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fc00/0xc6b31a1b598ea643 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee64c expref: 33 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740427.826333:0:5842:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fc00/0xc6b31a1b598ea643 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee64c expref: 33 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740427.826372:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f0d82841500) 00010000:00010000:0.0:1790740427.826376:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790740427.826379:0:5842:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0dc132fc00, rc 0) 00000100:00100000:0.0:1790740427.826442:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db5a69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+33:11364:x1877727133109632:12345-192.168.203.58@tcp:101:lfs.0 Request processed in 249us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740427.826449:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 147 00000100:00100000:3.0:1790740427.834195:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740427.835446:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133109888 00000100:00100000:1.0:1790740427.835459:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133109888 00000100:00100000:1.0:1790740427.835527:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 39 00000100:00100000:1.0:1790740427.835537:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+33:11364:x1877727133109888:12345-192.168.203.58@tcp:35:lfs.0 00000100:00100000:1.0:1790740427.835841:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+34:11364:x1877727133109888:12345-192.168.203.58@tcp:35:lfs.0 Request processed in 305us (1654us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1790740427.835850:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 39 00000100:00100000:1.0:1790740427.982038:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740427.982258:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133110144 00000100:00100000:3.0:1790740427.982268:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133110144 00000100:00100000:3.0:1790740427.982328:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 148 00000100:00100000:3.0:1790740427.982343:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+34:11374:x1877727133110144:12345-192.168.203.58@tcp:101:lfs.0 00010000:00010000:3.0:1790740427.982367:0:8666:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740427.982387:0:8666:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f200/0xc6b31a1b598ea64a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee653 expref: -99 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790740427.982493:0:8666:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1790740427.984414:0:8666:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f200/0xc6b31a1b598ea64a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee653 expref: 36 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740427.984434:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0d98dcc200) 00010000:00010000:3.0:1790740427.984437:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790740427.984442:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f200/0xc6b31a1b598ea64a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee653 expref: 36 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740427.984458:0:8666:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0db6c0f200, rc 0) 00000100:00100000:3.0:1790740427.984888:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+35:11374:x1877727133110144:12345-192.168.203.58@tcp:101:lfs.0 Request processed in 2549us (2865us total) trans 4294967433 rc 301/301 00000100:00100000:3.0:1790740427.984897:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 148 00000100:00100000:3.0:1790740427.988434:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740427.988532:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133110272 00000100:00100000:0.0:1790740427.988543:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133110272 00000100:00100000:0.0:1790740427.988622:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 149 00000100:00100000:0.0:1790740427.988632:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+35:11374:x1877727133110272:12345-192.168.203.58@tcp:34:lfs.0 00010000:00010000:0.0:1790740427.988707:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fe00/0xc6b31a1b598ea658 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740427.988725:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fe00/0xc6b31a1b598ea658 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740427.988737:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fe00/0xc6b31a1b598ea658 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740427.988751:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598ea65f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740427.988758:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598ea65f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740427.988764:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598ea65f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740427.988847:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e400/0xc6b31a1b598ea666 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740427.988868:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e400/0xc6b31a1b598ea666 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740427.988875:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e400/0xc6b31a1b598ea666 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790740427.988914:0:5842:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e400/0xc6b31a1b598ea666 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740427.988925:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fe00/0xc6b31a1b598ea658 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740427.988932:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fe00/0xc6b31a1b598ea658 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740427.988939:0:5842:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fe00/0xc6b31a1b598ea658 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740427.988945:0:5842:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132fe00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1790740427.988949:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fe00/0xc6b31a1b598ea658 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740427.988957:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fe00/0xc6b31a1b598ea658 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740427.988969:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f0d98dccd00) 00010000:00010000:0.0:1790740427.988972:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740427.988977:0:5842:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fe00/0xc6b31a1b598ea658 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740427.988984:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fe00/0xc6b31a1b598ea658 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740427.989004:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598ea65f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740427.989010:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598ea65f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740427.989016:0:5842:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598ea65f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740427.989021:0:5842:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132ee00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1790740427.989024:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598ea65f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740427.990812:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598ea65f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740427.990835:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8f0d82841300) 00010000:00010000:0.0:1790740427.990838:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740427.990842:0:5842:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598ea65f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740427.990848:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598ea65f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740427.990872:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e400/0xc6b31a1b598ea666 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740427.990878:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e400/0xc6b31a1b598ea666 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740427.990883:0:5842:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e400/0xc6b31a1b598ea666 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740427.990903:0:5842:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132e400 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1790740427.990907:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e400/0xc6b31a1b598ea666 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740427.990913:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e400/0xc6b31a1b598ea666 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740427.990922:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f0d82841500) 00010000:00010000:0.0:1790740427.990924:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740427.990927:0:5842:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e400/0xc6b31a1b598ea666 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740427.990932:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e400/0xc6b31a1b598ea666 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740427.991042:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+35:11374:x1877727133110272:12345-192.168.203.58@tcp:34:lfs.0 Request processed in 2397us (2603us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740427.991053:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 149 00000100:00100000:1.0:1790740427.997637:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740427.997718:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133110528 00000100:00100000:3.0:1790740427.997728:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133110528 00000100:00100000:3.0:1790740427.997772:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 40 00000100:00100000:3.0:1790740427.997782:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+35:11374:x1877727133110528:12345-192.168.203.58@tcp:35:lfs.0 00000100:00100000:3.0:1790740427.998012:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+36:11374:x1877727133110528:12345-192.168.203.58@tcp:35:lfs.0 Request processed in 231us (392us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1790740427.998020:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 40 00000100:00100000:3.0:1790740428.045701:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740428.045968:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133110784 00000100:00100000:0.0:1790740428.045978:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133110784 00000100:00100000:0.0:1790740428.046046:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 150 00000100:00100000:0.0:1790740428.046057:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+36:11377:x1877727133110784:12345-192.168.203.58@tcp:101:lfs.0 00010000:00010000:0.0:1790740428.046082:0:5844:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740428.046115:0:5844:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e400/0xc6b31a1b598ea66d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee65a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740428.046317:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598ea674 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740428.046351:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598ea674 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740428.046361:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598ea674 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740428.046376:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fe00/0xc6b31a1b598ea67b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740428.046383:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fe00/0xc6b31a1b598ea67b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740428.046390:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fe00/0xc6b31a1b598ea67b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740428.046766:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ec00/0xc6b31a1b598ea682 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740428.046776:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ec00/0xc6b31a1b598ea682 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740428.046783:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ec00/0xc6b31a1b598ea682 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790740428.046793:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1790740428.046884:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598ea674 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740428.046892:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598ea674 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740428.046899:0:5844:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598ea674 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740428.046911:0:5844:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132ee00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1790740428.046915:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598ea674 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740428.046923:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598ea674 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740428.046934:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f0d98dccd00) 00010000:00010000:0.0:1790740428.046937:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740428.046942:0:5844:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598ea674 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740428.046948:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598ea674 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740428.046961:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fe00/0xc6b31a1b598ea67b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740428.046967:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fe00/0xc6b31a1b598ea67b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740428.046972:0:5844:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fe00/0xc6b31a1b598ea67b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740428.046977:0:5844:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132fe00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1790740428.046980:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fe00/0xc6b31a1b598ea67b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740428.046986:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fe00/0xc6b31a1b598ea67b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740428.047017:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8f0d82841300) 00010000:00010000:0.0:1790740428.047019:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740428.047023:0:5844:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fe00/0xc6b31a1b598ea67b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740428.047038:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fe00/0xc6b31a1b598ea67b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740428.047083:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e400/0xc6b31a1b598ea66d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee65a expref: 39 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740428.047108:0:5844:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ec00/0xc6b31a1b598ea682 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee65a expref: 38 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740428.047114:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f0d82841500) 00010000:00010000:0.0:1790740428.047116:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790740428.047118:0:5844:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0dc132ec00, rc 0) 00000100:00100000:0.0:1790740428.048419:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+38:11377:x1877727133110784:12345-192.168.203.58@tcp:101:lfs.0 Request processed in 2349us (2712us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1790740428.048431:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 150 00000100:00100000:0.0:1790740428.056828:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740428.056984:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133110912 00000100:00100000:3.0:1790740428.056994:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133110912 00000100:00100000:3.0:1790740428.057061:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 151 00000100:00100000:3.0:1790740428.057085:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+38:11377:x1877727133110912:12345-192.168.203.58@tcp:54:lfs.0 00010000:00010000:3.0:1790740428.057171:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f200/0xc6b31a1b598ea690 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740428.057189:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f200/0xc6b31a1b598ea690 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740428.057203:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f200/0xc6b31a1b598ea690 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740428.057228:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f200/0xc6b31a1b598ea690 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740428.057235:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f200/0xc6b31a1b598ea690 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740428.057243:0:5843:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f200/0xc6b31a1b598ea690 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740428.057249:0:5843:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0f200 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1790740428.057254:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f200/0xc6b31a1b598ea690 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740428.057262:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f200/0xc6b31a1b598ea690 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740428.057276:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f0d82841500) 00010000:00010000:3.0:1790740428.057279:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790740428.057284:0:5843:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f200/0xc6b31a1b598ea690 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740428.057303:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f200/0xc6b31a1b598ea690 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740428.057395:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+38:11377:x1877727133110912:12345-192.168.203.58@tcp:54:lfs.0 Request processed in 310us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740428.057405:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 151 00000100:00100000:3.0:1790740428.060265:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740428.060366:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133111168 00000100:00100000:1.0:1790740428.060376:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133111168 00000100:00100000:1.0:1790740428.060657:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 41 00000100:00100000:1.0:1790740428.060668:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+38:11377:x1877727133111168:12345-192.168.203.58@tcp:35:lfs.0 00000100:00100000:1.0:1790740428.060935:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+39:11377:x1877727133111168:12345-192.168.203.58@tcp:35:lfs.0 Request processed in 268us (679us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1790740428.060942:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 41 00010000:00010000:1.0:1790740428.080722:0:11661:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740428.082800:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d9018ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158280960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790740428.082878:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740428.083247:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158280960 00000100:00100000:2.0:1790740428.083255:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158280960 00000100:00100000:2.0:1790740428.083345:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1790740428.083355:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1050c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1877727158280960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790740428.083377:0:6704:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790740428.083441:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1050c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1877727158280960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740428.083449:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1790740428.083733:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d9018ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158280960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790740428.361334:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740428.361775:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133111424 00000100:00100000:3.0:1790740428.361785:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133111424 00000100:00100000:3.0:1790740428.361880:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 152 00000100:00100000:3.0:1790740428.361891:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+39:11408:x1877727133111424:12345-192.168.203.58@tcp:101:cat.0 00010000:00010000:3.0:1790740428.361916:0:8666:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740428.361936:0:8666:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f200/0xc6b31a1b598ea697 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee661 expref: -99 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740428.362031:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fe00/0xc6b31a1b598ea69e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740428.362047:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fe00/0xc6b31a1b598ea69e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740428.362058:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fe00/0xc6b31a1b598ea69e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790740428.362069:0:8666:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1790740428.362201:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f200/0xc6b31a1b598ea697 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee661 expref: 42 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740428.362237:0:8666:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fe00/0xc6b31a1b598ea69e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee661 expref: 41 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740428.362259:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f0d82841500) 00010000:00010000:3.0:1790740428.362263:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790740428.362267:0:8666:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0db6c0fe00, rc 0) 00000100:00100000:3.0:1790740428.362333:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+41:11408:x1877727133111424:12345-192.168.203.58@tcp:101:cat.0 Request processed in 445us (1008us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1790740428.362341:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 152 00000100:00100000:0.0:1790740428.364853:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740428.365346:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133111680 00000100:00100000:3.0:1790740428.365355:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133111680 00000100:00100000:3.0:1790740428.365460:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 42 00000100:00100000:3.0:1790740428.365471:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+41:11408:x1877727133111680:12345-192.168.203.58@tcp:35:cat.0 00000100:00100000:3.0:1790740428.366669:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+42:11408:x1877727133111680:12345-192.168.203.58@tcp:35:cat.0 Request processed in 1195us (1818us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1790740428.366680:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 42 00000100:00100000:0.0:1790740428.366791:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740428.366883:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133111808 00000100:00100000:0.0:1790740428.366890:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133111808 00000100:00100000:0.0:1790740428.366936:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 12 00000100:00100000:0.0:1790740428.366945:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec599375-3198-45fd-a23a-c5620f07177c+42:2370:x1877727133111808:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790740428.366977:0:5829:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740428.367000:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fe00/0xc6b31a1b598ea69e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee661 expref: 42 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740428.367020:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f0d82841500) 00010000:00010000:0.0:1790740428.367026:0:5829:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740428.367370:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec599375-3198-45fd-a23a-c5620f07177c+41:2370:x1877727133111808:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 123us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740428.367378:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 12 00000100:00100000:0.0:1790740428.449198:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740428.449272:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133112064 00000100:00100000:2.0:1790740428.449282:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133112064 00000100:00100000:2.0:1790740428.449345:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 153 00000100:00100000:2.0:1790740428.449354:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+41:11414:x1877727133112064:12345-192.168.203.58@tcp:101:dd.0 00010000:00010000:2.0:1790740428.449377:0:5842:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740428.449379:0:5842:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1790740428.449403:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f400/0xc6b31a1b598ea604 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee637 expref: 41 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740428.449432:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f0d98dccd00) 00010000:00010000:2.0:1790740428.449437:0:5842:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790740428.449451:0:5842:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598ea6ac lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee668 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740428.449541:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea6b3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740428.449621:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ec00/0xc6b31a1b598ea682 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee65a expref: 41 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740428.449631:0:5842:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea6b3 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740428.449665:0:5842:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ec00/0xc6b31a1b598ea682 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee65a expref: 41 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740428.449677:0:5842:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ec00/0xc6b31a1b598ea682 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee65a expref: 41 pid: 5844 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740428.449690:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d9018d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1877727158281088:192.168.203.58@tcp:104: 00000100:00100000:2.0:1790740428.449792:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d81324840 going to sleep for 11 seconds 00000100:00100000:2.0:1790740428.453140:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d9018d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1877727158281088:192.168.203.58@tcp:104: 00010000:00010000:2.0:1790740428.453182:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea6b3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740428.454444:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740428.454522:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133112192 00000100:00100000:1.0:1790740428.454530:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133112192 00010000:00010000:1.0:1790740428.454568:0:5830:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ec00/0xc6b31a1b598ea682 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee65a expref: 42 pid: 5844 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740428.454676:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 62 00000100:00100000:1.0:1790740428.454686:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda43100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec599375-3198-45fd-a23a-c5620f07177c+42:2370:x1877727133112192:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790740428.454701:0:5830:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740428.454708:0:5830:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ec00/0xc6b31a1b598ea682 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee65a expref: 42 pid: 5844 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740428.454719:0:5830:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ec00/0xc6b31a1b598ea682 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee65a expref: 42 pid: 5844 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740428.454741:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ec00/0xc6b31a1b598ea682 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee65a expref: 42 pid: 5844 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740428.454757:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f0d82841500) 00010000:00010000:1.0:1790740428.454762:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea6b3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740428.454772:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea6b3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740428.454781:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea6b3 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740428.454803:0:5830:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740428.454859:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda43100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec599375-3198-45fd-a23a-c5620f07177c+41:2370:x1877727133112192:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 173us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740428.454867:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 62 00010000:00010000:0.0:1790740428.455474:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea6b3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740428.455482:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea6b3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790740428.455501:0:5842:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1790740428.455678:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598ea6ac lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee668 expref: 42 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740428.455695:0:5842:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea6b3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee668 expref: 41 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740428.455702:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f0d82841500) 00010000:00010000:0.0:1790740428.455705:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790740428.455707:0:5842:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d87595800, rc 0) 00000100:00100000:0.0:1790740428.455743:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+41:11414:x1877727133112064:12345-192.168.203.58@tcp:101:dd.0 Request processed in 6391us (6554us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1790740428.455758:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 153 00000100:00100000:0.0:1790740428.460911:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740428.461061:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133112448 00000100:00100000:1.0:1790740428.461136:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133112448 00000100:00100000:1.0:1790740428.461374:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 154 00000100:00100000:1.0:1790740428.461384:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+41:11414:x1877727133112448:12345-192.168.203.58@tcp:36:dd.0 00010000:00010000:1.0:1790740428.461695:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031200/0xc6b31a1b598ea6c1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740428.461715:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031200/0xc6b31a1b598ea6c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740428.461726:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031200/0xc6b31a1b598ea6c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790740428.461779:0:5844:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:1.0:1790740428.461805:0:5844:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000006d8abae reply state 00000000d9ee399c transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031200/0xc6b31a1b598ea6c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740428.461814:0:5844:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790740428.461908:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+44:11414:x1877727133112448:12345-192.168.203.58@tcp:36:dd.0 Request processed in 524us (1005us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1790740428.461916:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 154 00000020:00080000:1.0:1790740428.461921:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790740428.466432:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031200/0xc6b31a1b598ea6c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740428.466450:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031200/0xc6b31a1b598ea6c1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740428.466458:0:3290:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031200/0xc6b31a1b598ea6c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740428.466464:0:3290:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d80031200 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1790740428.466481:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031200/0xc6b31a1b598ea6c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740428.466489:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031200/0xc6b31a1b598ea6c1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740428.466505:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f0d82841500) 00010000:00010000:3.0:1790740428.466508:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740428.466512:0:3290:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031200/0xc6b31a1b598ea6c1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740428.466519:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031200/0xc6b31a1b598ea6c1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790740428.664680:0:6725:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:1.0:1790740428.664703:0:6725:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:1.0:1790740428.668950:0:5865:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967439 is committed 00000001:00080000:1.0:1790740428.668992:0:5865:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967441 is committed 00000004:00080000:1.0:1790740428.669005:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1790740428.669036:0:5865:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f0d813246c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1790740428.669042:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f0dc1e3b200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f0d81324f00 00000020:00080000:1.0:1790740428.669046:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f0dc1e3b900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f0d8743dc00 00000100:00100000:3.0:1790740428.669332:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790740428.669353:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbee5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158281216:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1790740428.669418:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740428.669483:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158281216 00000100:00100000:3.0:1790740428.669504:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158281216 00000100:00100000:3.0:1790740428.669549:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790740428.669558:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158281216:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1790740428.669607:0:6700:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:3.0:1790740428.669809:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6abc87cb, atime: 0x6abc87cb, ctime: 0x6abc87cb, blocks: 0xb 00010000:00010000:3.0:1790740428.669819:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045ad5cd3/0xc6b31a1b598ea6c8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740428.669836:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=344s v=(0 0) 00010000:00010000:3.0:1790740428.669840:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790740428.669846:0:6700:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045ad5cd3/0xc6b31a1b598ea6c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740428.669883:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045ad5cd3/0xc6b31a1b598ea6c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740428.669894:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045ad5cd3/0xc6b31a1b598ea6c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740428.669902:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000045ad5cd3/0xc6b31a1b598ea6c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740428.669921:0:6700:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790740428.670677:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790740428.670686:0:5832:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000045ad5cd3/0xc6b31a1b598ea6c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740428.670699:0:5832:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0f200 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:0.0:1790740428.670704:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000045ad5cd3/0xc6b31a1b598ea6c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740428.670715:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000045ad5cd3/0xc6b31a1b598ea6c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740428.670733:0:5832:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000045ad5cd3/0xc6b31a1b598ea6c8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740428.670742:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045ad5cd3/0xc6b31a1b598ea6c8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740428.670765:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740428.670768:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740428.670770:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740428.670840:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1877727158281216:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1280us (1419us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1790740428.670853:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790740428.670886:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:0.0:1790740428.670893:0:3303:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:0.0:1790740428.670912:0:3303:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8f0dbee5d880 x1877727158281216/t4294967307(4294967307) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1790740444 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1790740428.670936:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f0dbee5d880/2, rc 0, transno 4294967307 00000100:00100000:0.0:1790740428.670941:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbee5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158281216:0@lo:6:osp-syn-0-0.0 00000020:00080000:3.0:1790740428.671050:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1790740428.671191:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1790740428.720452:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740428.720712:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133112576 00000100:00100000:3.0:1790740428.720723:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133112576 00000100:00100000:3.0:1790740428.720774:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 155 00000100:00100000:3.0:1790740428.720784:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+16:11428:x1877727133112576:12345-192.168.203.58@tcp:101:stat.0 00010000:00010000:3.0:1790740428.720808:0:5843:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740428.720829:0:5843:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e200/0xc6b31a1b598ea6cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee66f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740428.720895:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f800/0xc6b31a1b598ea6d6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740428.720927:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f800/0xc6b31a1b598ea6d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740428.720939:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f800/0xc6b31a1b598ea6d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740428.720954:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598ea6dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740428.720961:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598ea6dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740428.720968:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598ea6dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740428.721274:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598ea6e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740428.721288:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea6b3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee668 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740428.721297:0:5843:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598ea6e4 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740428.721343:0:5843:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea6b3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee668 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740428.721358:0:5843:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea6b3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee668 expref: 17 pid: 5842 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740428.721386:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbee5d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1877727158281344:192.168.203.58@tcp:104: 00000100:00100000:3.0:1790740428.721489:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d85cd0840 going to sleep for 11 seconds 00000100:00100000:1.0:1790740428.724134:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740428.724246:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbee5d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1877727158281344:192.168.203.58@tcp:104: 00010000:00010000:3.0:1790740428.724284:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598ea6e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740428.724473:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133112832 00000100:00100000:2.0:1790740428.724480:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133112832 00000100:00100000:2.0:1790740428.724536:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 43 00000100:00100000:2.0:1790740428.724546:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec599375-3198-45fd-a23a-c5620f07177c+18:5608:x1877727133112832:12345-192.168.203.58@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1790740428.726883:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec599375-3198-45fd-a23a-c5620f07177c+19:5608:x1877727133112832:12345-192.168.203.58@tcp:35:ldlm_bl.0 Request processed in 2330us (2747us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1790740428.726897:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 43 00000100:00100000:0.0:1790740428.732287:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740428.732847:0:8506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133112960 00000100:00100000:2.0:1790740428.732871:0:8506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133112960 00010000:00010000:2.0:1790740428.732907:0:8506:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea6b3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee668 expref: 19 pid: 5842 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740428.732949:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 63 00000100:00100000:2.0:1790740428.733331:0:8506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d87400c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec599375-3198-45fd-a23a-c5620f07177c+19:2370:x1877727133112960:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790740428.733347:0:8506:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740428.733354:0:8506:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea6b3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee668 expref: 19 pid: 5842 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740428.733368:0:8506:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea6b3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee668 expref: 19 pid: 5842 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740428.733390:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea6b3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee668 expref: 19 pid: 5842 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740428.733406:0:8506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f0d82841500) 00010000:00010000:2.0:1790740428.733411:0:8506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598ea6e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740428.733420:0:8506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598ea6e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740428.733532:0:8506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598ea6e4 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740428.733661:0:8506:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790740428.733719:0:8506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d87400c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec599375-3198-45fd-a23a-c5620f07177c+18:2370:x1877727133112960:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 392us (1439us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740428.733738:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 63 00010000:00010000:3.0:1790740428.733915:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598ea6e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740428.733924:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598ea6e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790740428.734118:0:5843:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1790740428.734123:0:5843:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790740428.734145:0:5843:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598ea6e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740428.734158:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598ea6e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740428.734168:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f800/0xc6b31a1b598ea6d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740428.734176:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f800/0xc6b31a1b598ea6d6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740428.734183:0:5843:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f800/0xc6b31a1b598ea6d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740428.734190:0:5843:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0f800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1790740428.734201:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f800/0xc6b31a1b598ea6d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740428.734210:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f800/0xc6b31a1b598ea6d6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740428.734220:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f0d98dccd00) 00010000:00010000:3.0:1790740428.734223:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740428.734227:0:5843:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f800/0xc6b31a1b598ea6d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740428.734234:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f800/0xc6b31a1b598ea6d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740428.734247:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598ea6dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740428.734254:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598ea6dd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740428.734260:0:5843:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598ea6dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740428.734269:0:5843:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0e600 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1790740428.734272:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598ea6dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740428.734278:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598ea6dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740428.734285:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8f0d944f6b00) 00010000:00010000:3.0:1790740428.734288:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740428.734295:0:5843:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598ea6dd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740428.734302:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598ea6dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740428.734337:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e200/0xc6b31a1b598ea6cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee66f expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740428.734350:0:5843:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598ea6e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee66f expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740428.734357:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f0d82841500) 00010000:00010000:3.0:1790740428.734359:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790740428.734361:0:5843:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0db6c0f000, rc 0) 00000100:00100000:3.0:1790740428.734441:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+17:11428:x1877727133112576:12345-192.168.203.58@tcp:101:stat.0 Request processed in 13658us (13998us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740428.734449:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 155 00000100:00100000:0.0:1790740428.814784:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740428.815025:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133113216 00000100:00100000:3.0:1790740428.815035:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133113216 00000100:00100000:3.0:1790740428.815101:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 156 00000100:00100000:3.0:1790740428.815112:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+17:11434:x1877727133113216:12345-192.168.203.58@tcp:36:truncate.0 00010000:00010000:3.0:1790740428.815179:0:8666:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740428.815204:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598ea6e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee66f expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740428.815222:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f0d82841500) 00010000:00010000:3.0:1790740428.815228:0:8666:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790740428.815428:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e200/0xc6b31a1b598ea6eb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740428.815442:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e200/0xc6b31a1b598ea6eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740428.815451:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e200/0xc6b31a1b598ea6eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790740428.815498:0:8666:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:3.0:1790740428.815523:0:8666:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000536e0036 reply state 00000000c8353cb0 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e200/0xc6b31a1b598ea6eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740428.815531:0:8666:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790740428.815675:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+19:11434:x1877727133113216:12345-192.168.203.58@tcp:36:truncate.0 Request processed in 564us (899us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1790740428.815683:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 156 00000020:00080000:3.0:1790740428.815688:0:8666:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790740428.820907:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e200/0xc6b31a1b598ea6eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740428.820925:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e200/0xc6b31a1b598ea6eb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740428.820933:0:3289:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e200/0xc6b31a1b598ea6eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740428.820938:0:3289:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0e200 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740428.820942:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e200/0xc6b31a1b598ea6eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740428.820960:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e200/0xc6b31a1b598ea6eb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740428.820976:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f0d82841500) 00010000:00010000:2.0:1790740428.820979:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740428.820984:0:3289:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e200/0xc6b31a1b598ea6eb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740428.820989:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e200/0xc6b31a1b598ea6eb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740429.009146:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740429.009244:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133113344 00000100:00100000:2.0:1790740429.009254:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133113344 00000100:00100000:2.0:1790740429.009333:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 157 00000100:00100000:2.0:1790740429.009346:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+18:11448:x1877727133113344:12345-192.168.203.58@tcp:101:stat.0 00010000:00010000:2.0:1790740429.009369:0:5842:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740429.009401:0:5842:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea6f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee676 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740429.009472:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea6f9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740429.009487:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea6f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740429.009498:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea6f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740429.009510:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea700 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740429.009517:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea700 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740429.009524:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea700 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740429.010055:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598ea707 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740429.010066:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598ea707 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740429.010073:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598ea707 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740429.010118:0:5842:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1790740429.010123:0:5842:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790740429.010143:0:5842:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598ea707 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740429.010161:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598ea707 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740429.010169:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea6f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740429.010176:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea6f9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740429.010183:0:5842:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea6f9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740429.010190:0:5842:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87594800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740429.010194:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea6f9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740429.010202:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea6f9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740429.010213:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f0d98dccd00) 00010000:00010000:2.0:1790740429.010216:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740429.010220:0:5842:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea6f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740429.010227:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea6f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740429.010239:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea700 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740429.010245:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea700 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740429.010257:0:5842:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea700 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740429.010263:0:5842:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87594200 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740429.010266:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea700 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740429.010272:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea700 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740429.010280:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8f0d98dcce00) 00010000:00010000:2.0:1790740429.010282:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740429.010285:0:5842:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea700 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740429.010290:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea700 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740429.010439:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea6f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee676 expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740429.010454:0:5842:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598ea707 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee676 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740429.010461:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f0d82841500) 00010000:00010000:2.0:1790740429.010463:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790740429.010465:0:5842:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d87594000, rc 0) 00000100:00100000:2.0:1790740429.010527:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+19:11448:x1877727133113344:12345-192.168.203.58@tcp:101:stat.0 Request processed in 1184us (1389us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740429.010544:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 157 00000100:00080000:0.0:1790740429.011168:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790740429.109448:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740429.119389:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740429.119602:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133113600 00000100:00100000:3.0:1790740429.119621:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133113600 00000100:00100000:3.0:1790740429.119683:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 158 00000100:00100000:3.0:1790740429.119692:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc0962300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+19:11458:x1877727133113600:12345-192.168.203.58@tcp:101:lfs.0 00010000:00010000:3.0:1790740429.119711:0:8666:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740429.119744:0:8666:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598ea70e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee67d expref: -99 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790740429.119829:0:8666:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1790740429.119942:0:8666:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598ea70e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee67d expref: 21 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740429.119957:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0d98dcc200) 00010000:00010000:3.0:1790740429.119969:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790740429.119975:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598ea70e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee67d expref: 21 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740429.119989:0:8666:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0db6c0f000, rc 0) 00000100:00100000:3.0:1790740429.120049:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc0962300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+20:11458:x1877727133113600:12345-192.168.203.58@tcp:101:lfs.0 Request processed in 357us (669us total) trans 4294967445 rc 301/301 00000100:00100000:3.0:1790740429.120056:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 158 00000100:00100000:1.0:1790740429.132373:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740429.132479:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133113856 00000100:00100000:3.0:1790740429.132489:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133113856 00000100:00100000:3.0:1790740429.132558:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 44 00000100:00100000:3.0:1790740429.132568:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0da2038050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+20:11458:x1877727133113856:12345-192.168.203.58@tcp:35:lfs.0 00000100:00100000:3.0:1790740429.132810:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0da2038050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+21:11458:x1877727133113856:12345-192.168.203.58@tcp:35:lfs.0 Request processed in 243us (445us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1790740429.132818:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 44 00000100:00100000:0.0:1790740429.242064:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740429.242167:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133114112 00000100:00100000:3.0:1790740429.242176:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133114112 00000100:00100000:3.0:1790740429.242243:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 159 00000100:00100000:3.0:1790740429.242253:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc0960380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+21:11464:x1877727133114112:12345-192.168.203.58@tcp:101:bash.0 00010000:00010000:3.0:1790740429.242275:0:5843:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740429.242296:0:5843:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598ea71c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee684 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740429.242421:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598ea723 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740429.242439:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598ea707 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee676 expref: 22 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740429.242462:0:5843:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598ea723 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740429.242498:0:5843:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598ea707 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee676 expref: 22 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740429.242511:0:5843:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598ea707 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee676 expref: 22 pid: 5842 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740429.242525:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbee5fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1877727158281472:192.168.203.58@tcp:104: 00000100:00100000:3.0:1790740429.242645:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d85cd0000 going to sleep for 11 seconds 00000100:00100000:3.0:1790740429.253109:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbee5fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1877727158281472:192.168.203.58@tcp:104: 00010000:00010000:3.0:1790740429.253142:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598ea723 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740429.253459:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740429.253550:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133114240 00000100:00100000:2.0:1790740429.253557:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133114240 00010000:00010000:2.0:1790740429.253639:0:5828:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598ea707 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee676 expref: 23 pid: 5842 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740429.253678:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 64 00000100:00100000:2.0:1790740429.253688:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc0961c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec599375-3198-45fd-a23a-c5620f07177c+23:2369:x1877727133114240:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790740429.253703:0:5828:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740429.253711:0:5828:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598ea707 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee676 expref: 23 pid: 5842 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740429.253723:0:5828:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598ea707 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee676 expref: 23 pid: 5842 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740429.253746:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598ea707 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee676 expref: 23 pid: 5842 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740429.253761:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f0d82841500) 00010000:00010000:2.0:1790740429.253765:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598ea723 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740429.253775:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598ea723 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740429.253783:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598ea723 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740429.253831:0:5828:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790740429.253884:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc0961c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec599375-3198-45fd-a23a-c5620f07177c+22:2369:x1877727133114240:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 197us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740429.253892:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 64 00010000:00010000:3.0:1790740429.253955:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598ea723 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740429.253963:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598ea723 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790740429.253981:0:5843:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1790740429.254142:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598ea71c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee684 expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740429.254158:0:5843:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598ea723 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee684 expref: 22 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740429.254177:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f0d82841500) 00010000:00010000:3.0:1790740429.254180:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790740429.254182:0:5843:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0db6c0e600, rc 0) 00000100:00100000:3.0:1790740429.254220:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc0960380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+22:11464:x1877727133114112:12345-192.168.203.58@tcp:101:bash.0 Request processed in 11969us (12166us total) trans 4294967447 rc 0/0 00000100:00100000:3.0:1790740429.254227:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 159 00000100:00100000:0.0:1790740429.269288:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740429.269519:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133114496 00000100:00100000:3.0:1790740429.269529:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133114496 00000100:00100000:1.0:1790740429.269738:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 160 00000100:00100000:1.0:1790740429.269753:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc0962680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+22:11464:x1877727133114496:12345-192.168.203.58@tcp:36:bash.0 00010000:00010000:1.0:1790740429.270004:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030c00/0xc6b31a1b598ea731 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.270023:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030c00/0xc6b31a1b598ea731 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.270034:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030c00/0xc6b31a1b598ea731 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790740429.270093:0:5844:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:1.0:1790740429.270118:0:5844:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000d195ffbf reply state 00000000666bf092 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030c00/0xc6b31a1b598ea731 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740429.270127:0:5844:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790740429.270217:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc0962680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+25:11464:x1877727133114496:12345-192.168.203.58@tcp:36:bash.0 Request processed in 468us (937us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1790740429.270224:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 160 00000020:00080000:1.0:1790740429.270230:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790740429.272047:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030c00/0xc6b31a1b598ea731 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740429.272063:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030c00/0xc6b31a1b598ea731 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740429.272071:0:3290:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030c00/0xc6b31a1b598ea731 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740429.272077:0:3290:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d80030c00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1790740429.272092:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030c00/0xc6b31a1b598ea731 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740429.272100:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030c00/0xc6b31a1b598ea731 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740429.272115:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f0d82841500) 00010000:00010000:3.0:1790740429.272118:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740429.272123:0:3290:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030c00/0xc6b31a1b598ea731 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740429.272147:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030c00/0xc6b31a1b598ea731 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740429.283997:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740429.284367:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133114624 00000100:00100000:2.0:1790740429.284376:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133114624 00000100:00100000:2.0:1790740429.284433:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 161 00000100:00100000:2.0:1790740429.284444:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1292680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+24:11464:x1877727133114624:12345-192.168.203.58@tcp:101:bash.0 00010000:00010000:2.0:1790740429.284467:0:5842:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740429.284488:0:5842:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea738 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee68b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740429.284632:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea73f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740429.284648:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598ea723 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee684 expref: 25 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740429.284658:0:5842:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea73f lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740429.284690:0:5842:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598ea723 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee684 expref: 25 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740429.284703:0:5842:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598ea723 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee684 expref: 25 pid: 5843 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740429.284717:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d9018d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1877727158281600:192.168.203.58@tcp:104: 00000100:00100000:2.0:1790740429.284813:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d813240c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790740429.289968:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740429.290485:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133114752 00000100:00100000:1.0:1790740429.290495:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133114752 00010000:00010000:1.0:1790740429.290541:0:5829:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598ea723 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee684 expref: 26 pid: 5843 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740429.290629:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 65 00000100:00100000:1.0:1790740429.290639:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1293100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec599375-3198-45fd-a23a-c5620f07177c+26:2369:x1877727133114752:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790740429.290669:0:5829:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740429.290676:0:5829:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598ea723 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee684 expref: 26 pid: 5843 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.290689:0:5829:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598ea723 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee684 expref: 26 pid: 5843 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.290710:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f0d82841500) 00010000:00010000:1.0:1790740429.290716:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea73f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.290725:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea73f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.290732:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea73f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.290752:0:5829:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740429.290808:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1293100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec599375-3198-45fd-a23a-c5620f07177c+26:2369:x1877727133114752:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 170us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740429.290815:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 65 00010000:00010000:2.0:1790740429.291852:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598ea723 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee684 expref: 25 pid: 5843 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740429.291872:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d9018d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1877727158281600:192.168.203.58@tcp:104: 00010000:00010000:2.0:1790740429.291894:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea73f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740429.291902:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea73f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740429.291908:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea73f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740429.291954:0:5842:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1790740429.291959:0:5842:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790740429.291977:0:5842:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea73f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740429.292007:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea738 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee68b expref: 25 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740429.292020:0:5842:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea73f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee68b expref: 24 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740429.292028:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f0d82841500) 00010000:00010000:2.0:1790740429.292031:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790740429.292034:0:5842:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d87594200, rc 0) 00000100:00100000:2.0:1790740429.292094:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1292680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+24:11464:x1877727133114624:12345-192.168.203.58@tcp:101:bash.0 Request processed in 7652us (8109us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740429.292114:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 161 00000100:00100000:0.0:1790740429.301187:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740429.301264:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133115008 00000100:00100000:3.0:1790740429.301273:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133115008 00000100:00100000:3.0:1790740429.301330:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 45 00000100:00100000:3.0:1790740429.301340:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+24:11464:x1877727133115008:12345-192.168.203.58@tcp:35:bash.0 00000100:00100000:3.0:1790740429.301626:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+25:11464:x1877727133115008:12345-192.168.203.58@tcp:35:bash.0 Request processed in 287us (447us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1790740429.301634:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 45 00000100:00100000:3.0:1790740429.406347:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740429.406471:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133115264 00000100:00100000:1.0:1790740429.406482:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133115264 00000100:00100000:1.0:1790740429.406553:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 162 00000100:00100000:1.0:1790740429.406565:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+25:11474:x1877727133115264:12345-192.168.203.58@tcp:101:lfs.0 00010000:00010000:1.0:1790740429.406641:0:5844:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740429.406664:0:5844:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031800/0xc6b31a1b598ea746 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee692 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790740429.406772:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1790740429.406892:0:5844:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031800/0xc6b31a1b598ea746 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee692 expref: 27 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.406907:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0d98dcc200) 00010000:00010000:1.0:1790740429.406910:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790740429.406915:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031800/0xc6b31a1b598ea746 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee692 expref: 27 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.406929:0:5844:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d80031800, rc 0) 00000100:00100000:1.0:1790740429.406981:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+26:11474:x1877727133115264:12345-192.168.203.58@tcp:101:lfs.0 Request processed in 419us (644us total) trans 4294967451 rc 301/301 00000100:00100000:1.0:1790740429.406989:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 162 00000100:00100000:0.0:1790740429.410200:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740429.410286:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133115392 00000100:00100000:3.0:1790740429.410296:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133115392 00000100:00100000:3.0:1790740429.410351:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 163 00000100:00100000:3.0:1790740429.410371:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc12e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+26:11474:x1877727133115392:12345-192.168.203.58@tcp:34:lfs.0 00010000:00010000:3.0:1790740429.410440:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598ea754 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740429.410458:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598ea754 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740429.410468:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598ea754 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740429.410482:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f800/0xc6b31a1b598ea75b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740429.410488:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f800/0xc6b31a1b598ea75b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740429.410512:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f800/0xc6b31a1b598ea75b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740429.411725:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e400/0xc6b31a1b598ea762 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740429.411739:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e400/0xc6b31a1b598ea762 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740429.411749:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e400/0xc6b31a1b598ea762 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790740429.411792:0:5843:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e400/0xc6b31a1b598ea762 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740429.411805:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598ea754 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740429.411823:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598ea754 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740429.411831:0:5843:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598ea754 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740429.411837:0:5843:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0f000 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1790740429.411841:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598ea754 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740429.411849:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598ea754 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740429.411861:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f0d98dccd00) 00010000:00010000:0.0:1790740429.411864:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740429.411869:0:5843:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598ea754 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740429.411874:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598ea754 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740429.411888:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f800/0xc6b31a1b598ea75b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740429.411894:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f800/0xc6b31a1b598ea75b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740429.411900:0:5843:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f800/0xc6b31a1b598ea75b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740429.411905:0:5843:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0f800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1790740429.411914:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f800/0xc6b31a1b598ea75b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740429.411921:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f800/0xc6b31a1b598ea75b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740429.411928:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8f0d944f6b00) 00010000:00010000:0.0:1790740429.411931:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740429.411934:0:5843:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f800/0xc6b31a1b598ea75b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740429.411940:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f800/0xc6b31a1b598ea75b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740429.411955:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e400/0xc6b31a1b598ea762 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740429.411961:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e400/0xc6b31a1b598ea762 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740429.411967:0:5843:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e400/0xc6b31a1b598ea762 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740429.411971:0:5843:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132e400 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1790740429.411974:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e400/0xc6b31a1b598ea762 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740429.411980:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e400/0xc6b31a1b598ea762 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740429.411987:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f0d82841500) 00010000:00010000:0.0:1790740429.411990:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740429.412000:0:5843:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e400/0xc6b31a1b598ea762 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740429.412006:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e400/0xc6b31a1b598ea762 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740429.412214:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc12e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+26:11474:x1877727133115392:12345-192.168.203.58@tcp:34:lfs.0 Request processed in 1851us (2019us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740429.412223:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 163 00000100:00100000:1.0:1790740429.415076:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740429.415152:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133115648 00000100:00100000:3.0:1790740429.415162:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133115648 00000100:00100000:3.0:1790740429.415214:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 46 00000100:00100000:3.0:1790740429.415224:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+26:11474:x1877727133115648:12345-192.168.203.58@tcp:35:lfs.0 00000100:00100000:3.0:1790740429.415457:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+27:11474:x1877727133115648:12345-192.168.203.58@tcp:35:lfs.0 Request processed in 234us (389us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1790740429.415464:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 46 00000100:00100000:3.0:1790740429.463935:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740429.464174:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133115904 00000100:00100000:1.0:1790740429.464184:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133115904 00000100:00100000:1.0:1790740429.464242:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 164 00000100:00100000:1.0:1790740429.464253:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+27:11477:x1877727133115904:12345-192.168.203.58@tcp:101:lfs.0 00010000:00010000:1.0:1790740429.464275:0:5844:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740429.464294:0:5844:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030c00/0xc6b31a1b598ea769 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee699 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.464397:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030600/0xc6b31a1b598ea770 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.464413:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030600/0xc6b31a1b598ea770 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.464432:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030600/0xc6b31a1b598ea770 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.464447:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031600/0xc6b31a1b598ea777 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.464455:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031600/0xc6b31a1b598ea777 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.464463:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031600/0xc6b31a1b598ea777 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.464821:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030a00/0xc6b31a1b598ea77e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.464832:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030a00/0xc6b31a1b598ea77e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.464839:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030a00/0xc6b31a1b598ea77e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790740429.464850:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1790740429.464938:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030600/0xc6b31a1b598ea770 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.464947:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030600/0xc6b31a1b598ea770 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.464953:0:5844:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030600/0xc6b31a1b598ea770 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.464959:0:5844:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d80030600 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1790740429.464969:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030600/0xc6b31a1b598ea770 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.464975:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030600/0xc6b31a1b598ea770 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.464988:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f0d98dccd00) 00010000:00010000:1.0:1790740429.464991:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740429.464995:0:5844:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030600/0xc6b31a1b598ea770 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.465001:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030600/0xc6b31a1b598ea770 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.465014:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031600/0xc6b31a1b598ea777 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.465019:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031600/0xc6b31a1b598ea777 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.465025:0:5844:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031600/0xc6b31a1b598ea777 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.465030:0:5844:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d80031600 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1790740429.465033:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031600/0xc6b31a1b598ea777 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.465039:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031600/0xc6b31a1b598ea777 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.465045:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8f0d84a1e100) 00010000:00010000:1.0:1790740429.465048:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740429.465057:0:5844:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031600/0xc6b31a1b598ea777 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.465063:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031600/0xc6b31a1b598ea777 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.465129:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030c00/0xc6b31a1b598ea769 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee699 expref: 30 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.465143:0:5844:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030a00/0xc6b31a1b598ea77e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee699 expref: 29 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.465150:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f0d82841500) 00010000:00010000:1.0:1790740429.465152:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790740429.465155:0:5844:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d80030a00, rc 0) 00000100:00100000:1.0:1790740429.465211:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+29:11477:x1877727133115904:12345-192.168.203.58@tcp:101:lfs.0 Request processed in 960us (1285us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1790740429.465221:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 164 00000100:00100000:1.0:1790740429.469193:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740429.469279:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133116032 00000100:00100000:2.0:1790740429.469290:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133116032 00000100:00100000:2.0:1790740429.469345:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 165 00000100:00100000:2.0:1790740429.469354:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+29:11477:x1877727133116032:12345-192.168.203.58@tcp:54:lfs.0 00010000:00010000:2.0:1790740429.469427:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea78c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740429.469444:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea78c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740429.469455:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea78c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740429.469480:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea78c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740429.469488:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea78c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740429.469496:0:5842:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea78c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740429.469514:0:5842:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87594e00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740429.469519:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea78c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740429.469526:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea78c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740429.469538:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f0d82841500) 00010000:00010000:2.0:1790740429.469554:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790740429.469560:0:5842:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea78c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740429.469567:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea78c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740429.469834:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+29:11477:x1877727133116032:12345-192.168.203.58@tcp:54:lfs.0 Request processed in 480us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740429.469843:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 165 00000100:00100000:0.0:1790740429.472908:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740429.473359:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133116160 00000100:00100000:1.0:1790740429.473368:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133116160 00000100:00100000:0.0:1790740429.474977:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740429.475100:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133116416 00000100:00100000:3.0:1790740429.475109:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133116416 00000100:00100000:3.0:1790740429.475150:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 47 00000100:00100000:3.0:1790740429.475159:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc12e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+30:11477:x1877727133116416:12345-192.168.203.58@tcp:35:lfs.0 00000100:00100000:3.0:1790740429.475513:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc12e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+31:11477:x1877727133116416:12345-192.168.203.58@tcp:35:lfs.0 Request processed in 354us (541us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1790740429.475521:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 47 00000100:00100000:1.0:1790740429.478488:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 13 00000100:00100000:1.0:1790740429.478566:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc12e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec599375-3198-45fd-a23a-c5620f07177c+30:2369:x1877727133116160:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790740429.478605:0:5830:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740429.478641:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030a00/0xc6b31a1b598ea77e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee699 expref: 30 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.478663:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f0d82841500) 00010000:00010000:1.0:1790740429.478682:0:5830:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740429.478809:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc12e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec599375-3198-45fd-a23a-c5620f07177c+29:2369:x1877727133116160:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 309us (5910us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740429.478817:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 13 00000100:00100000:0.0:1790740429.672702:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740429.672781:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133116672 00000100:00100000:1.0:1790740429.672791:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133116672 00000100:00100000:1.0:1790740429.672988:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 166 00000100:00100000:1.0:1790740429.673000:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc12e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+29:11495:x1877727133116672:12345-192.168.203.58@tcp:101:cat.0 00010000:00010000:1.0:1790740429.673025:0:5844:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740429.673044:0:5844:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030a00/0xc6b31a1b598ea793 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee6a0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.673172:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030c00/0xc6b31a1b598ea79a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.673186:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030c00/0xc6b31a1b598ea79a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.673196:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030c00/0xc6b31a1b598ea79a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790740429.673206:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1790740429.673340:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030a00/0xc6b31a1b598ea793 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6a0 expref: 32 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.673529:0:5844:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030c00/0xc6b31a1b598ea79a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6a0 expref: 31 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.673644:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f0d82841500) 00010000:00010000:1.0:1790740429.673659:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1790740429.673664:0:5844:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d80030c00, rc 0) 00000100:00100000:1.0:1790740429.673729:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc12e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+31:11495:x1877727133116672:12345-192.168.203.58@tcp:101:cat.0 Request processed in 732us (1035us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1790740429.673737:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 166 00000100:00100000:0.0:1790740429.701946:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740429.702057:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133116800 00000100:00100000:2.0:1790740429.702068:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133116800 00000100:00100000:2.0:1790740429.702277:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 167 00000100:00100000:2.0:1790740429.702288:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc12e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+31:11496:x1877727133116800:12345-192.168.203.58@tcp:101:lfs.0 00010000:00010000:2.0:1790740429.702310:0:5842:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740429.702329:0:5842:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea7a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee6a7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740429.702396:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea7af lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740429.702410:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea7af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740429.702422:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea7af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740429.702456:0:5842:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1790740429.702459:0:5842:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790740429.702476:0:5842:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea7af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740429.702667:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea7a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6a7 expref: 33 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740429.702687:0:5842:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea7af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6a7 expref: 32 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740429.702695:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f0d98dccd00) 00010000:00010000:2.0:1790740429.702699:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790740429.702702:0:5842:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d87594800, rc 0) 00000100:00100000:2.0:1790740429.702813:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc12e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+32:11496:x1877727133116800:12345-192.168.203.58@tcp:101:lfs.0 Request processed in 526us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740429.702821:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 167 00000100:00100000:0.0:1790740429.708123:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740429.708766:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133117184 00000100:00100000:3.0:1790740429.708775:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133117184 00000100:00100000:3.0:1790740429.708857:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 48 00000100:00100000:3.0:1790740429.708867:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc12e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+32:11496:x1877727133117184:12345-192.168.203.58@tcp:35:lfs.0 00000100:00100000:3.0:1790740429.709176:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc12e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+33:11496:x1877727133117184:12345-192.168.203.58@tcp:35:lfs.0 Request processed in 310us (1060us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1790740429.709183:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 48 00000100:00100000:1.0:1790740429.711408:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740429.713740:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133117312 00000100:00100000:0.0:1790740429.713753:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133117312 00000100:00100000:0.0:1790740429.713935:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 14 00000100:00100000:0.0:1790740429.713946:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec599375-3198-45fd-a23a-c5620f07177c+33:11496:x1877727133117312:12345-192.168.203.58@tcp:103:lfs.0 00010000:00010000:0.0:1790740429.713963:0:5829:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1790740429.713987:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea73f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee68b expref: 33 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740429.714009:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030c00/0xc6b31a1b598ea79a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6a0 expref: 32 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740429.714023:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fc00/0xc6b31a1b598ea643 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee64c expref: 31 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740429.714033:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f0d82841500) 00010000:00010000:0.0:1790740429.714058:0:5829:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740429.714401:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec599375-3198-45fd-a23a-c5620f07177c+30:11496:x1877727133117312:12345-192.168.203.58@tcp:103:lfs.0 Request processed in 456us (2997us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740429.714410:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 14 00000100:00100000:1.0:1790740429.717001:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740429.717096:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133117440 00000100:00100000:3.0:1790740429.717105:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133117440 00000100:00100000:3.0:1790740429.717154:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 168 00000100:00100000:3.0:1790740429.717164:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+30:11496:x1877727133117440:12345-192.168.203.58@tcp:58:lfs.0 00010000:00010000:3.0:1790740429.717261:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e800/0xc6b31a1b598ea7b6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740429.717278:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e800/0xc6b31a1b598ea7b6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740429.717290:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e800/0xc6b31a1b598ea7b6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790740429.717890:0:8666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1790740429.717966:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+30:11496:x1877727133117440:12345-192.168.203.58@tcp:58:lfs.0 Request processed in 803us (972us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740429.717975:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 168 00000100:00100000:1.0:1790740429.736288:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740429.736455:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133117568 00000100:00100000:0.0:1790740429.736464:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133117568 00000100:00100000:0.0:1790740429.736527:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 169 00000100:00100000:0.0:1790740429.736538:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+30:11498:x1877727133117568:12345-192.168.203.58@tcp:101:lfs.0 00010000:00010000:0.0:1790740429.736556:0:5843:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740429.736842:0:5843:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fc00/0xc6b31a1b598ea7bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee6ae expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.736911:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031200/0xc6b31a1b598ea7c4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.736926:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031200/0xc6b31a1b598ea7c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.736936:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031200/0xc6b31a1b598ea7c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.736952:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030600/0xc6b31a1b598ea7cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.736959:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030600/0xc6b31a1b598ea7cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.736966:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030600/0xc6b31a1b598ea7cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.737234:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030c00/0xc6b31a1b598ea7d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.737253:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030c00/0xc6b31a1b598ea7d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.737260:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030c00/0xc6b31a1b598ea7d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790740429.737294:0:5843:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1790740429.737364:0:5843:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790740429.737387:0:5843:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030c00/0xc6b31a1b598ea7d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.737398:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030c00/0xc6b31a1b598ea7d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.737406:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031200/0xc6b31a1b598ea7c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.737412:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031200/0xc6b31a1b598ea7c4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.737420:0:5843:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031200/0xc6b31a1b598ea7c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.737426:0:5843:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d80031200 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1790740429.737430:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031200/0xc6b31a1b598ea7c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.737437:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031200/0xc6b31a1b598ea7c4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.737448:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f0d98dccd00) 00010000:00010000:1.0:1790740429.737451:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740429.737462:0:5843:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031200/0xc6b31a1b598ea7c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.737468:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031200/0xc6b31a1b598ea7c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.737483:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030600/0xc6b31a1b598ea7cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.737488:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030600/0xc6b31a1b598ea7cb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.737494:0:5843:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030600/0xc6b31a1b598ea7cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.737499:0:5843:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d80030600 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1790740429.737501:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030600/0xc6b31a1b598ea7cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.737508:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030600/0xc6b31a1b598ea7cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.737516:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8f0d84a1e100) 00010000:00010000:1.0:1790740429.737518:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740429.737521:0:5843:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030600/0xc6b31a1b598ea7cb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.737526:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030600/0xc6b31a1b598ea7cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.737556:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fc00/0xc6b31a1b598ea7bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6ae expref: 32 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.737694:0:5843:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030c00/0xc6b31a1b598ea7d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6ae expref: 31 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.737702:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f0d944f6500) 00010000:00010000:1.0:1790740429.737704:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790740429.737707:0:5843:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d80030c00, rc 0) 00000100:00100000:1.0:1790740429.737766:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+31:11498:x1877727133117568:12345-192.168.203.58@tcp:101:lfs.0 Request processed in 1229us (1486us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740429.737783:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 169 00000040:00080000:2.0:1790740429.937849:0:11679:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790740429.937859:0:11679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790740429.937922:0:11679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:2.0:1790740429.937929:0:11679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790740429.938066:0:11679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d9018d500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11679:1877727158281728:192.168.203.58@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790740429.938177:0:11679:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d81324f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790740429.941851:0:11679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d9018d500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11679:1877727158281728:192.168.203.58@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790740429.955760:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740429.956686:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133117696 00000100:00100000:2.0:1790740429.956704:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133117696 00000100:00100000:2.0:1790740429.956759:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 170 00000100:00100000:2.0:1790740429.956767:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+31:11509:x1877727133117696:12345-192.168.203.58@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790740429.956796:0:5844:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790740429.956911:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+31:11509:x1877727133117696:12345-192.168.203.58@tcp:53:lhsmtool_posix.0 Request processed in 144us (1166us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740429.956925:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 170 00000100:00100000:2.0:1790740429.974559:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740429.974644:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133117824 00000100:00100000:0.0:1790740429.974654:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133117824 00000100:00100000:0.0:1790740429.974717:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 171 00000100:00100000:0.0:1790740429.974728:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d9018d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+31:11509:x1877727133117824:12345-192.168.203.58@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1790740429.974795:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e200/0xc6b31a1b598ea7d9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740429.974813:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e200/0xc6b31a1b598ea7d9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740429.974824:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e200/0xc6b31a1b598ea7d9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740429.974838:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fc00/0xc6b31a1b598ea7e0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740429.974845:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fc00/0xc6b31a1b598ea7e0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740429.974851:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fc00/0xc6b31a1b598ea7e0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740429.974893:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea7e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740429.974903:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea7e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740429.974910:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea7e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790740429.974959:0:5842:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1790740429.974964:0:5842:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790740429.974977:0:5842:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea7e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740429.974987:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e200/0xc6b31a1b598ea7d9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740429.974995:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e200/0xc6b31a1b598ea7d9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740429.975002:0:5842:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e200/0xc6b31a1b598ea7d9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740429.975008:0:5842:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132e200 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1790740429.975013:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e200/0xc6b31a1b598ea7d9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740429.975031:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e200/0xc6b31a1b598ea7d9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740429.975045:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f0d944f6600) 00010000:00010000:0.0:1790740429.975054:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740429.975060:0:5842:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e200/0xc6b31a1b598ea7d9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740429.975068:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e200/0xc6b31a1b598ea7d9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740429.975091:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fc00/0xc6b31a1b598ea7e0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740429.975097:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fc00/0xc6b31a1b598ea7e0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740429.975103:0:5842:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fc00/0xc6b31a1b598ea7e0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740429.975107:0:5842:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132fc00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1790740429.975110:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fc00/0xc6b31a1b598ea7e0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740429.975115:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fc00/0xc6b31a1b598ea7e0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740429.975123:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff8f0d82841500) 00010000:00010000:0.0:1790740429.975125:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740429.975127:0:5842:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fc00/0xc6b31a1b598ea7e0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740429.975133:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fc00/0xc6b31a1b598ea7e0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740429.975146:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea7e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740429.975168:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea7e7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740429.975173:0:5842:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea7e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740429.975178:0:5842:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132f800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1790740429.975181:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea7e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740429.975187:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea7e7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740429.975195:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f0d944f6500) 00010000:00010000:0.0:1790740429.975197:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740429.975200:0:5842:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea7e7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740429.975206:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea7e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740429.975283:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d9018d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+31:11509:x1877727133117824:12345-192.168.203.58@tcp:34:lhsmtool_posix.0 Request processed in 555us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740429.975290:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 171 00000100:00100000:2.0:1790740429.980779:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740429.980867:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133118080 00000100:00100000:3.0:1790740429.980877:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133118080 00000100:00100000:3.0:1790740429.980932:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 172 00000100:00100000:3.0:1790740429.980942:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d9018f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+31:11509:x1877727133118080:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790740429.980961:0:5844:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740429.980978:0:5844:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea7ee lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee6b5 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740429.981086:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fc00/0xc6b31a1b598ea7f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740429.981102:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fc00/0xc6b31a1b598ea7f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740429.981126:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fc00/0xc6b31a1b598ea7f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790740429.981139:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1790740429.981230:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fc00/0xc6b31a1b598ea7f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740429.981238:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fc00/0xc6b31a1b598ea7f5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740429.981244:0:5844:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fc00/0xc6b31a1b598ea7f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740429.981249:0:5844:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0fc00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1790740429.981253:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fc00/0xc6b31a1b598ea7f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740429.981260:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fc00/0xc6b31a1b598ea7f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740429.981271:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f0d944f6500) 00010000:00010000:3.0:1790740429.981274:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790740429.981279:0:5844:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fc00/0xc6b31a1b598ea7f5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740429.981285:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fc00/0xc6b31a1b598ea7f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740429.981329:0:5844:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea7ee lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6b5 expref: 33 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740429.981349:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f0d944f6600) 00010000:00010000:3.0:1790740429.981351:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790740429.981355:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea7ee lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6b5 expref: 33 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740429.981364:0:5844:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0db6c0e000, rc 0) 00000100:00100000:3.0:1790740429.981422:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d9018f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+32:11509:x1877727133118080:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 Request processed in 482us (651us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1790740429.981430:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 172 00000100:00100000:3.0:1790740429.986722:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740429.987014:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133118208 00000100:00100000:1.0:1790740429.987024:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133118208 00000100:00100000:1.0:1790740429.987098:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 173 00000100:00100000:1.0:1790740429.987109:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+32:11509:x1877727133118208:12345-192.168.203.58@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790740429.987144:0:5842:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790740429.987770:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+32:11509:x1877727133118208:12345-192.168.203.58@tcp:53:lhsmtool_posix.0 Request processed in 660us (1054us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740429.987779:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 173 00000100:00100000:2.0:1790740429.996963:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740429.997040:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133118464 00000100:00100000:1.0:1790740429.997050:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133118464 00000100:00100000:1.0:1790740429.997114:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 174 00000100:00100000:1.0:1790740429.997124:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d9018e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+32:11509:x1877727133118464:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790740429.997144:0:8666:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740429.997147:0:8666:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1790740429.997172:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea7af lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6a7 expref: 32 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.997196:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f0d98dccd00) 00010000:00010000:1.0:1790740429.997201:0:8666:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790740429.997219:0:8666:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031600/0xc6b31a1b598ea803 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee6bc expref: -99 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790740429.998022:0:8666:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:1.0:1790740429.998283:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030a00/0xc6b31a1b598ea80a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.998299:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030a00/0xc6b31a1b598ea80a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.998310:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030a00/0xc6b31a1b598ea80a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.998368:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031600/0xc6b31a1b598ea803 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6bc expref: 34 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.998385:0:8666:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030a00/0xc6b31a1b598ea80a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6bc expref: 33 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740429.998393:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8f0d84a1e100) 00010000:00010000:1.0:1790740429.998397:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790740429.998400:0:8666:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d80030a00, rc 0) 00000100:00100000:1.0:1790740429.998465:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d9018e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+33:11509:x1877727133118464:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 Request processed in 1342us (1511us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1790740429.998474:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 174 00000100:00100000:2.0:1790740430.003684:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740430.003818:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133118720 00000100:00100000:3.0:1790740430.003829:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133118720 00000100:00100000:3.0:1790740430.003952:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 175 00000100:00100000:3.0:1790740430.003963:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d9018c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+33:11509:x1877727133118720:12345-192.168.203.58@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790740430.004014:0:5843:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740430.004037:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030a00/0xc6b31a1b598ea80a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6bc expref: 33 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.004053:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8f0d84a1e100) 00010000:00010000:3.0:1790740430.004063:0:5843:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790740430.004092:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea818 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.004105:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea818 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.004125:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea818 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.004138:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fc00/0xc6b31a1b598ea81f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x73de3e93 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.004145:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fc00/0xc6b31a1b598ea81f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x73de3e93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.004151:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fc00/0xc6b31a1b598ea81f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x73de3e93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.004350:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea818 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.004359:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea818 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.004366:0:5843:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea818 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.004375:0:5843:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0e000 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1790740430.004379:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea818 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.004386:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea818 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.004394:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f0d98dccd00) 00010000:00010000:3.0:1790740430.004397:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740430.004401:0:5843:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea818 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.004414:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea818 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.004427:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fc00/0xc6b31a1b598ea81f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x73de3e93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.004433:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fc00/0xc6b31a1b598ea81f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x73de3e93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.004438:0:5843:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fc00/0xc6b31a1b598ea81f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x73de3e93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.004444:0:5843:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0fc00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1790740430.004447:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fc00/0xc6b31a1b598ea81f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x73de3e93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.004453:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fc00/0xc6b31a1b598ea81f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x73de3e93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.004460:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x73de3e93 (ffff8f0d944f6700) 00010000:00010000:3.0:1790740430.004462:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740430.004464:0:5843:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fc00/0xc6b31a1b598ea81f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x73de3e93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.004470:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fc00/0xc6b31a1b598ea81f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x73de3e93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740430.006008:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d9018c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+32:11509:x1877727133118720:12345-192.168.203.58@tcp:36:lhsmtool_posix.0 Request processed in 2039us (2328us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790740430.006019:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 175 00000100:00100000:2.0:1790740430.012800:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740430.013114:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133118848 00000100:00100000:1.0:1790740430.013125:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133118848 00000100:00100000:1.0:1790740430.013188:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 176 00000100:00100000:1.0:1790740430.013197:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d9018ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+32:11509:x1877727133118848:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790740430.013217:0:8666:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740430.013240:0:8666:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031600/0xc6b31a1b598ea826 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee6c3 expref: -99 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740430.013274:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031800/0xc6b31a1b598ea82d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740430.013289:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031800/0xc6b31a1b598ea82d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740430.013300:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031800/0xc6b31a1b598ea82d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740430.013409:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031600/0xc6b31a1b598ea826 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6c3 expref: 34 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740430.013427:0:8666:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031800/0xc6b31a1b598ea82d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6c3 expref: 33 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740430.013434:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8f0d84a1ec00) 00010000:00010000:1.0:1790740430.013437:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790740430.013441:0:8666:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d80031800, rc 0) 00000100:00100000:1.0:1790740430.013510:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d9018ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+33:11509:x1877727133118848:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 Request processed in 314us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740430.013518:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 176 00000100:00100000:2.0:1790740430.017980:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740430.019978:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133119104 00000100:00100000:0.0:1790740430.019993:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133119104 00000100:00100000:0.0:1790740430.020063:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 177 00000100:00100000:0.0:1790740430.020082:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db6dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+33:11509:x1877727133119104:12345-192.168.203.58@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790740430.020283:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea834 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740430.020312:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea834 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740430.020323:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea834 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790740430.020758:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:0.0:1790740430.020769:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 345971195786ns, next at 346971193131ns, rc = 0 00000004:00010000:0.0:1790740430.020845:0:5842:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000000dae8eed reply state 0000000029940c6f transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea834 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740430.020855:0:5842:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790740430.021084:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db6dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+35:11509:x1877727133119104:12345-192.168.203.58@tcp:36:lhsmtool_posix.0 Request processed in 1002us (3102us total) trans 4294967459 rc 0/0 00000100:00100000:0.0:1790740430.021093:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 177 00000100:00100000:2.0:1790740430.028897:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00010000:00010000:0.0:1790740430.029015:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea834 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740430.029028:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea834 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740430.029036:0:3289:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea834 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740430.029042:0:3289:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132f800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1790740430.029048:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea834 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740430.029055:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea834 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740430.029100:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8f0d84a1ec00) 00010000:00010000:0.0:1790740430.029104:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1790740430.029110:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133119232 00010000:00010000:0.0:1790740430.029118:0:3289:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea834 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740430.029121:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133119232 00010000:00010000:0.0:1790740430.029129:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea834 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740430.029185:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 178 00000100:00100000:1.0:1790740430.029194:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db6dc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+34:11509:x1877727133119232:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790740430.029215:0:8666:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740430.029231:0:8666:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030a00/0xc6b31a1b598ea83b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee6ca expref: -99 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740430.029288:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030a00/0xc6b31a1b598ea83b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6ca expref: 35 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740430.029302:0:8666:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030a00/0xc6b31a1b598ea83b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6ca expref: 35 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740430.029367:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8f0d84a1ec00) 00010000:00010000:1.0:1790740430.029370:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790740430.029373:0:8666:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d80030a00, rc 0) 00000100:00100000:1.0:1790740430.029423:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db6dc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+35:11509:x1877727133119232:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 Request processed in 230us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740430.029430:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 178 00000100:00100000:3.0:1790740430.042913:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740430.043221:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133119360 00000100:00100000:1.0:1790740430.043231:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133119360 00000100:00100000:1.0:1790740430.043330:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 51 00000100:00100000:1.0:1790740430.043339:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec599375-3198-45fd-a23a-c5620f07177c+6:2369:x1877727133119360:12345-192.168.203.58@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1790740430.043687:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec599375-3198-45fd-a23a-c5620f07177c+7:2369:x1877727133119360:12345-192.168.203.58@tcp:2:lhsmtool_posix.0 Request processed in 348us (783us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1790740430.043697:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 51 00000100:00080000:0.0:1790740430.043766:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790740430.047762:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740430.047997:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133119616 00000100:00100000:1.0:1790740430.048008:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133119616 00000100:00100000:1.0:1790740430.048119:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 49 00000100:00100000:1.0:1790740430.048130:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1a42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec599375-3198-45fd-a23a-c5620f07177c+35:11509:x1877727133119616:12345-192.168.203.58@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1790740430.048358:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1a42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec599375-3198-45fd-a23a-c5620f07177c+36:11509:x1877727133119616:12345-192.168.203.58@tcp:35:lhsmtool_posix.0 Request processed in 230us (604us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1790740430.048366:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 49 00000100:00100000:2.0:1790740430.051098:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740430.051277:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133119872 00000100:00100000:3.0:1790740430.051286:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133119872 00000100:00100000:3.0:1790740430.051337:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 179 00000100:00100000:3.0:1790740430.051361:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1a43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+36:11509:x1877727133119872:12345-192.168.203.58@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790740430.051666:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1a43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+36:11509:x1877727133119872:12345-192.168.203.58@tcp:57:lhsmtool_posix.0 Request processed in 306us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740430.051674:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 179 00000100:00100000:2.0:1790740430.054998:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740430.055708:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133120000 00000100:00100000:1.0:1790740430.055718:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133120000 00000100:00100000:1.0:1790740430.055807:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 180 00000100:00100000:1.0:1790740430.055817:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8812f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+36:11509:x1877727133120000:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790740430.055837:0:8666:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740430.055865:0:8666:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031600/0xc6b31a1b598ea842 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee6d1 expref: -99 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740430.055944:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031200/0xc6b31a1b598ea849 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740430.055959:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031200/0xc6b31a1b598ea849 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740430.055973:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031200/0xc6b31a1b598ea849 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790740430.056010:0:8666:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790740430.056030:0:8666:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031200/0xc6b31a1b598ea849 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740430.056056:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031600/0xc6b31a1b598ea842 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6d1 expref: 38 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740430.056099:0:8666:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031200/0xc6b31a1b598ea849 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6d1 expref: 37 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740430.056116:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8f0d84a1ec00) 00010000:00010000:1.0:1790740430.056119:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1790740430.056123:0:8666:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d80031200, rc 0) 00000100:00100000:1.0:1790740430.056181:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8812f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+37:11509:x1877727133120000:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 Request processed in 365us (1323us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740430.056188:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 180 00000100:00100000:2.0:1790740430.060049:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740430.060209:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133120128 00000100:00100000:0.0:1790740430.060219:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133120128 00000100:00100000:0.0:1790740430.060278:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 52 00000100:00100000:0.0:1790740430.060288:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8812df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec599375-3198-45fd-a23a-c5620f07177c+7:2370:x1877727133120128:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790740430.060305:0:6699:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740430.060325:0:6699:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004cf7e740/0xc6b31a1b598ea850 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee6d8 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790740430.060352:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abc87ce, blocks: 0x1 00010000:00010000:0.0:1790740430.060372:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=346s v=(0 0) 00010000:00010000:0.0:1790740430.060377:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740430.060387:0:6699:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004cf7e740/0xc6b31a1b598ea850 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6d8 expref: 8 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740430.060405:0:6699:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004cf7e740/0xc6b31a1b598ea850 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6d8 expref: 8 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740430.060419:0:6699:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0dc132f800, rc 0) 00000100:00100000:0.0:1790740430.060501:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8812df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec599375-3198-45fd-a23a-c5620f07177c+8:2370:x1877727133120128:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 Request processed in 207us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740430.060509:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 52 00000100:00100000:2.0:1790740430.065179:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740430.065276:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133120384 00000100:00100000:3.0:1790740430.065285:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133120384 00000100:00100000:3.0:1790740430.065341:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 181 00000100:00100000:3.0:1790740430.065351:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8812d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+37:11509:x1877727133120384:12345-192.168.203.58@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790740430.065675:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8812d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+37:11509:x1877727133120384:12345-192.168.203.58@tcp:57:lhsmtool_posix.0 Request processed in 324us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740430.065684:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 181 00000100:00100000:0.0:1790740430.069432:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740430.069698:0:8460:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133120512 00000100:00100000:3.0:1790740430.069708:0:8460:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133120512 00000100:00100000:3.0:1790740430.069766:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 53 00000100:00100000:3.0:1790740430.069776:0:8460:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc12e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec599375-3198-45fd-a23a-c5620f07177c+8:11509:x1877727133120512:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790740430.069794:0:8460:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740430.069811:0:8460:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088059c93/0xc6b31a1b598ea857 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee6df expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.069845:0:8460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004cf7e740/0xc6b31a1b598ea850 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6d8 expref: 9 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.069855:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790740430.069869:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790740430.069875:0:8460:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088059c93/0xc6b31a1b598ea857 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6df expref: 9 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.070047:0:8460:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004cf7e740/0xc6b31a1b598ea850 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6d8 expref: 9 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.070066:0:8460:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004cf7e740/0xc6b31a1b598ea850 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6d8 expref: 9 pid: 6699 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740430.070090:0:8460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbee5f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8460:1877727158281856:192.168.203.58@tcp:104: 00000100:00100000:3.0:1790740430.070302:0:8460:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d85cd0000 going to sleep for 11 seconds 00000100:00100000:3.0:1790740430.073912:0:8460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbee5f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8460:1877727158281856:192.168.203.58@tcp:104: 00000100:00100000:2.0:1790740430.073912:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00010000:00010000:3.0:1790740430.073953:0:8460:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000088059c93/0xc6b31a1b598ea857 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6df expref: 9 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.073974:0:8460:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0db6c0f600, rc 0) 00000100:00100000:3.0:1790740430.074034:0:8460:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc12e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec599375-3198-45fd-a23a-c5620f07177c+9:11509:x1877727133120512:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 Request processed in 4258us (4610us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740430.074043:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 53 00000100:00100000:1.0:1790740430.078159:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133120640 00000100:00100000:1.0:1790740430.078186:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133120640 00010000:00010000:1.0:1790740430.078288:0:5828:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004cf7e740/0xc6b31a1b598ea850 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6d8 expref: 9 pid: 6699 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740430.079087:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 66 00000100:00100000:1.0:1790740430.079101:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8498c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec599375-3198-45fd-a23a-c5620f07177c+9:2369:x1877727133120640:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790740430.079118:0:5828:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740430.079142:0:5828:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004cf7e740/0xc6b31a1b598ea850 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6d8 expref: 9 pid: 6699 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740430.079159:0:5828:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004cf7e740/0xc6b31a1b598ea850 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6d8 expref: 9 pid: 6699 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740430.079184:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004cf7e740/0xc6b31a1b598ea850 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6d8 expref: 9 pid: 6699 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740430.079219:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790740430.079223:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790740430.079232:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000088059c93/0xc6b31a1b598ea857 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6df expref: 8 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740430.079242:0:5828:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088059c93/0xc6b31a1b598ea857 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6df expref: 8 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740430.079283:0:5828:0:(ldlm_lockd.c:1085:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000088059c93/0xc6b31a1b598ea857 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6df expref: 8 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740430.079308:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda77b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5828:1877727158281984:192.168.203.58@tcp:105: 00000100:00100000:1.0:1790740430.079475:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d84989cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790740430.084227:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda77b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5828:1877727158281984:192.168.203.58@tcp:105: 00010000:00010000:1.0:1790740430.084255:0:5828:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740430.084308:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8498c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec599375-3198-45fd-a23a-c5620f07177c+8:2369:x1877727133120640:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 5211us (10401us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740430.084318:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 66 00000100:00100000:0.0:1790740430.089476:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740430.089556:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133120768 00000100:00100000:3.0:1790740430.089565:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133120768 00002000:00100000:3.0:1790740430.089647:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8f0dc12e6680 x1877727133120768/t0(0) o4->ec599375-3198-45fd-a23a-c5620f07177c@192.168.203.58@tcp:486/0 lens 504/0 e 0 to 0 dl 1790740441 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790740430.089658:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f0dc12e6680 with x1877727133120768 ext(0->8) 00002000:00010000:3.0:1790740430.089664:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f0dc12e6680 00000100:00100000:3.0:1790740430.089689:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 4 00000100:00100000:3.0:1790740430.089705:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc12e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ec599375-3198-45fd-a23a-c5620f07177c+8:2370:x1877727133120768:12345-192.168.203.58@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1790740430.090320:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc12e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ec599375-3198-45fd-a23a-c5620f07177c+10:2370:x1877727133120768:12345-192.168.203.58@tcp:4:lhsmtool_posix.0 Request processed in 615us (851us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1790740430.090328:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 4 00002000:00100000:3.0:1790740430.090335:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8f0dc12e6680 x1877727133120768/t4294967314(0) o4->ec599375-3198-45fd-a23a-c5620f07177c@192.168.203.58@tcp:486/0 lens 504/448 e 0 to 0 dl 1790740441 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790740430.090342:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f0dc12e6680 with x1877727133120768 ext(0->8) 00002000:00010000:3.0:1790740430.090345:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f0dc12e6680 00000100:00100000:0.0:1790740430.095860:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740430.096400:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133120896 00000100:00100000:3.0:1790740430.096411:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133120896 00000100:00100000:3.0:1790740430.096630:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 182 00000100:00100000:3.0:1790740430.096641:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc12e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+37:11509:x1877727133120896:12345-192.168.203.58@tcp:44:lhsmtool_posix.0 00010000:00010000:1.0:1790740430.128757:0:11661:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1790740430.154324:0:5865:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:1.0:1790740430.154338:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000100:00100000:0.0:1790740430.154816:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790740430.154834:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc12e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158282112:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1790740430.154897:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:2.0:1790740430.155190:0:12420:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:2.0:1790740430.155249:0:12420:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:0.0:1790740430.155384:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158282112 00000100:00100000:0.0:1790740430.155392:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158282112 00000100:00080000:2.0:1790740430.155595:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790740430.155696:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790740430.155708:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc12e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1877727158282112:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1790740430.155876:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1790740430.155880:0:6699:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1790740430 00002000:00010000:0.0:1790740430.155883:0:6699:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1790740430.155885:0:6699:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1790740430 -> 1790740430 00002000:00010000:0.0:1790740430.155888:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1790740430.156016:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc12e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1877727158282112:12345-0@lo:2:osp-syn-1-0.0 Request processed in 309us (1117us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1790740430.156024:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:2.0:1790740430.156113:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f0dc12e7b80/2, rc 0, transno 4294967315 00000100:00100000:2.0:1790740430.156119:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc12e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158282112:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1790740430.156849:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc12e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+18:11509:x1877727133120896:12345-192.168.203.58@tcp:44:lhsmtool_posix.0 Request processed in 60207us (60993us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740430.156858:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 182 00000020:00080000:3.0:1790740430.156883:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1790740430.156893:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1790740430.160227:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740430.161215:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133121024 00000100:00100000:2.0:1790740430.161226:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133121024 00000100:00100000:2.0:1790740430.161313:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 55 00000100:00100000:2.0:1790740430.161324:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec599375-3198-45fd-a23a-c5620f07177c+10:2370:x1877727133121024:12345-192.168.203.58@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1790740430.229645:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec599375-3198-45fd-a23a-c5620f07177c+10:2370:x1877727133121024:12345-192.168.203.58@tcp:16:lhsmtool_posix.0 Request processed in 68315us (69415us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740430.229659:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 55 00000001:00080000:0.0:1790740430.229696:0:7642:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:0.0:1790740430.229706:0:7642:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:0.0:1790740430.229712:0:7642:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:0.0:1790740430.234223:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740430.234596:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133121280 00000100:00100000:1.0:1790740430.234614:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133121280 00000100:00100000:1.0:1790740430.234667:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 183 00000100:00100000:1.0:1790740430.234689:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc12e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+18:11509:x1877727133121280:12345-192.168.203.58@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790740430.234744:0:5843:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740430.234770:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031200/0xc6b31a1b598ea849 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6d1 expref: 18 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740430.234789:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8f0d84a1ec00) 00010000:00010000:1.0:1790740430.234794:0:5843:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790740430.234823:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030600/0xc6b31a1b598ea85e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740430.234838:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030600/0xc6b31a1b598ea85e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740430.234849:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030600/0xc6b31a1b598ea85e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790740430.235343:0:5843:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000005c871899 reply state 000000001809fa18 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030600/0xc6b31a1b598ea85e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740430.235353:0:5843:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790740430.235458:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc12e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+19:11509:x1877727133121280:12345-192.168.203.58@tcp:36:lhsmtool_posix.0 Request processed in 771us (1243us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1790740430.235467:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 183 00010000:00010000:3.0:1790740430.240420:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030600/0xc6b31a1b598ea85e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.240440:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030600/0xc6b31a1b598ea85e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.240449:0:3290:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030600/0xc6b31a1b598ea85e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.240457:0:3290:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d80030600 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1790740430.240472:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030600/0xc6b31a1b598ea85e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.240481:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030600/0xc6b31a1b598ea85e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.240514:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8f0d84a1ec00) 00010000:00010000:3.0:1790740430.240519:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740430.240524:0:3290:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030600/0xc6b31a1b598ea85e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.240531:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030600/0xc6b31a1b598ea85e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740430.243355:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740430.243547:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133121408 00000100:00100000:1.0:1790740430.243557:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133121408 00000100:00100000:1.0:1790740430.243642:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 56 00000100:00100000:1.0:1790740430.243653:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc12e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec599375-3198-45fd-a23a-c5620f07177c+7:2369:x1877727133121408:12345-192.168.203.58@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1790740430.243953:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1790740430.243957:0:6699:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1790740430 -> 1790740429 00002000:00010000:1.0:1790740430.243974:0:6699:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1790740427 00002000:00010000:1.0:1790740430.243976:0:6699:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1790740430 -> 1790740429 00002000:00010000:1.0:1790740430.243979:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1790740430.244034:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc12e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec599375-3198-45fd-a23a-c5620f07177c+8:2369:x1877727133121408:12345-192.168.203.58@tcp:2:lhsmtool_posix.0 Request processed in 382us (686us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1790740430.244042:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 56 00000100:00100000:1.0:1790740430.260492:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740430.261896:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133121664 00000100:00100000:0.0:1790740430.261907:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133121664 00000100:00100000:0.0:1790740430.262043:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 184 00000100:00100000:0.0:1790740430.262054:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+18:11509:x1877727133121664:12345-192.168.203.58@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1790740430.262132:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fe00/0xc6b31a1b598ea865 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740430.262149:0:8666:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031800/0xc6b31a1b598ea82d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6c3 expref: 18 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740430.262158:0:8666:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fe00/0xc6b31a1b598ea865 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740430.262191:0:8666:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031800/0xc6b31a1b598ea82d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6c3 expref: 18 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740430.262205:0:8666:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031800/0xc6b31a1b598ea82d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6c3 expref: 18 pid: 8666 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740430.262218:0:8666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc12e5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8666:1877727158282240:192.168.203.58@tcp:104: 00000100:00100000:0.0:1790740430.262300:0:8666:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0dbec320c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790740430.269303:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740430.269859:0:8506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133121792 00000100:00100000:3.0:1790740430.269868:0:8506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133121792 00010000:00010000:3.0:1790740430.269907:0:8506:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031800/0xc6b31a1b598ea82d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6c3 expref: 19 pid: 8666 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740430.270014:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 67 00000100:00100000:3.0:1790740430.270025:0:8506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec599375-3198-45fd-a23a-c5620f07177c+19:2370:x1877727133121792:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790740430.270039:0:8506:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740430.270046:0:8506:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031800/0xc6b31a1b598ea82d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6c3 expref: 19 pid: 8666 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.270059:0:8506:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031800/0xc6b31a1b598ea82d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6c3 expref: 19 pid: 8666 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.270155:0:8506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8f0d84a1ec00) 00010000:00010000:3.0:1790740430.270161:0:8506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fe00/0xc6b31a1b598ea865 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.270179:0:8506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fe00/0xc6b31a1b598ea865 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.270187:0:8506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fe00/0xc6b31a1b598ea865 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.270208:0:8506:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790740430.270257:0:8506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec599375-3198-45fd-a23a-c5620f07177c+19:2370:x1877727133121792:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 233us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740430.270266:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 67 00010000:00010000:2.0:1790740430.271901:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031800/0xc6b31a1b598ea82d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6c3 expref: 18 pid: 8666 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740430.271986:0:8666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc12e5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8666:1877727158282240:192.168.203.58@tcp:104: 00010000:00010000:2.0:1790740430.272011:0:8666:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fe00/0xc6b31a1b598ea865 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740430.272140:0:8666:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fe00/0xc6b31a1b598ea865 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740430.272148:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fe00/0xc6b31a1b598ea865 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740430.272179:0:8666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fe00/0xc6b31a1b598ea865 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740430.272186:0:8666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fe00/0xc6b31a1b598ea865 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740430.272194:0:8666:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fe00/0xc6b31a1b598ea865 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740430.272200:0:8666:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132fe00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1790740430.272205:0:8666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fe00/0xc6b31a1b598ea865 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740430.272212:0:8666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fe00/0xc6b31a1b598ea865 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740430.272227:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8f0d84a1ec00) 00010000:00010000:1.0:1790740430.272239:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1790740430.272245:0:8666:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fe00/0xc6b31a1b598ea865 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740430.272252:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fe00/0xc6b31a1b598ea865 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740430.272334:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+17:11509:x1877727133121664:12345-192.168.203.58@tcp:55:lhsmtool_posix.0 Request processed in 10280us (11847us total) trans 0 rc -22/-22 00000100:00100000:1.0:1790740430.272345:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 184 00000100:00100000:0.0:1790740430.277887:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740430.278031:0:8460:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133121920 00000100:00100000:3.0:1790740430.278042:0:8460:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133121920 00000100:00100000:3.0:1790740430.278103:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 57 00000100:00100000:3.0:1790740430.278114:0:8460:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc12e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec599375-3198-45fd-a23a-c5620f07177c+8:2370:x1877727133121920:12345-192.168.203.58@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1790740430.278160:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ba19b8fc/0xc6b31a1b598ea86c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.278186:0:8460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000088059c93/0xc6b31a1b598ea857 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6df expref: 8 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.278196:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790740430.278200:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790740430.278205:0:8460:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba19b8fc/0xc6b31a1b598ea86c lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.278240:0:8460:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000088059c93/0xc6b31a1b598ea857 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6df expref: 8 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.278267:0:8460:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000088059c93/0xc6b31a1b598ea857 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6df expref: 8 pid: 8460 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740430.278282:0:8460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbee5f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8460:1877727158282368:192.168.203.58@tcp:104: 00000100:00100000:3.0:1790740430.278365:0:8460:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0dbd398f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790740430.284952:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740430.285091:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133122048 00000100:00100000:1.0:1790740430.285100:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133122048 00010000:00010000:1.0:1790740430.285142:0:5830:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000088059c93/0xc6b31a1b598ea857 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6df expref: 9 pid: 8460 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740430.285184:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 68 00000100:00100000:1.0:1790740430.285194:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d87400450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec599375-3198-45fd-a23a-c5620f07177c+9:2370:x1877727133122048:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790740430.285208:0:5830:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740430.285230:0:5830:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000088059c93/0xc6b31a1b598ea857 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6df expref: 9 pid: 8460 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740430.285245:0:5830:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000088059c93/0xc6b31a1b598ea857 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6df expref: 9 pid: 8460 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740430.285270:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790740430.285274:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790740430.285280:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ba19b8fc/0xc6b31a1b598ea86c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740430.285303:0:5830:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba19b8fc/0xc6b31a1b598ea86c lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740430.285322:0:5830:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740430.285375:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d87400450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec599375-3198-45fd-a23a-c5620f07177c+9:2370:x1877727133122048:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 183us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740430.285382:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 68 00010000:00010000:3.0:1790740430.286516:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088059c93/0xc6b31a1b598ea857 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6df expref: 8 pid: 8460 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740430.286534:0:8460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbee5f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8460:1877727158282368:192.168.203.58@tcp:104: 00010000:00010000:3.0:1790740430.286554:0:8460:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ba19b8fc/0xc6b31a1b598ea86c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.286564:0:8460:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ba19b8fc/0xc6b31a1b598ea86c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.286616:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba19b8fc/0xc6b31a1b598ea86c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.286646:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ba19b8fc/0xc6b31a1b598ea86c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.286655:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba19b8fc/0xc6b31a1b598ea86c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.286679:0:8460:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba19b8fc/0xc6b31a1b598ea86c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.286687:0:8460:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0fc00 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:3.0:1790740430.286692:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba19b8fc/0xc6b31a1b598ea86c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.286701:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba19b8fc/0xc6b31a1b598ea86c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.286716:0:8460:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba19b8fc/0xc6b31a1b598ea86c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.286723:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba19b8fc/0xc6b31a1b598ea86c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740430.286789:0:8460:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc12e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec599375-3198-45fd-a23a-c5620f07177c+7:2370:x1877727133121920:12345-192.168.203.58@tcp:1:lhsmtool_posix.0 Request processed in 8677us (8910us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740430.286798:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 57 00000100:00100000:2.0:1790740430.290989:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740430.291121:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133122304 00000100:00100000:1.0:1790740430.291131:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133122304 00000100:00100000:1.0:1790740430.291195:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 185 00000100:00100000:1.0:1790740430.291207:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8498ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+17:11509:x1877727133122304:12345-192.168.203.58@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1790740430.291285:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031600/0xc6b31a1b598ea873 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740430.291303:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031600/0xc6b31a1b598ea873 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740430.291316:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031600/0xc6b31a1b598ea873 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740430.291509:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031800/0xc6b31a1b598ea87a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740430.291522:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030a00/0xc6b31a1b598ea83b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6ca expref: 18 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740430.291531:0:5842:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031800/0xc6b31a1b598ea87a lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740430.291624:0:5842:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030a00/0xc6b31a1b598ea83b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6ca expref: 18 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740430.291640:0:5842:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030a00/0xc6b31a1b598ea83b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6ca expref: 18 pid: 8666 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740430.291656:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda77480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1877727158282496:192.168.203.58@tcp:104: 00000100:00100000:1.0:1790740430.291733:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d985baf00 going to sleep for 11 seconds 00000100:00100000:2.0:1790740430.296222:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740430.296239:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda77480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1877727158282496:192.168.203.58@tcp:104: 00010000:00010000:1.0:1790740430.296264:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031800/0xc6b31a1b598ea87a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740430.296326:0:8506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133122432 00000100:00100000:3.0:1790740430.296333:0:8506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133122432 00010000:00010000:3.0:1790740430.296368:0:8506:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030a00/0xc6b31a1b598ea83b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6ca expref: 19 pid: 8666 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740430.296403:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 69 00000100:00100000:3.0:1790740430.296421:0:8506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8498c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec599375-3198-45fd-a23a-c5620f07177c+19:2370:x1877727133122432:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790740430.296434:0:8506:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740430.296440:0:8506:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030a00/0xc6b31a1b598ea83b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6ca expref: 19 pid: 8666 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.296452:0:8506:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030a00/0xc6b31a1b598ea83b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6ca expref: 19 pid: 8666 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.296471:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030a00/0xc6b31a1b598ea83b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6ca expref: 19 pid: 8666 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.296485:0:8506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8f0d84a1ec00) 00010000:00010000:3.0:1790740430.296490:0:8506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031800/0xc6b31a1b598ea87a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.296507:0:8506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031800/0xc6b31a1b598ea87a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.296514:0:8506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031800/0xc6b31a1b598ea87a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.296544:0:8506:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790740430.296757:0:8506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8498c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec599375-3198-45fd-a23a-c5620f07177c+18:2370:x1877727133122432:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 336us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740430.296765:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 69 00010000:00010000:2.0:1790740430.297338:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031800/0xc6b31a1b598ea87a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740430.297348:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031800/0xc6b31a1b598ea87a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790740430.297502:0:5842:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:2.0:1790740430.297660:0:5842:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:2.0:1790740430.297709:0:5842:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:2.0:1790740430.297808:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d8498d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5842:1877727158282624:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1790740430.299025:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740430.299111:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d81324b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790740430.299229:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158282624 00000100:00100000:3.0:1790740430.299238:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158282624 00000100:00100000:3.0:1790740430.299318:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790740430.299329:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8498c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5842:x1877727158282624:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1790740430.299435:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8498c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5842:x1877727158282624:12345-0@lo:1000:mdt00_000.0 Request processed in 109us (1577us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740430.299441:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790740430.299512:0:5842:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:2.0:1790740430.299517:0:5842:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f0dc12e7b80, transno 4294967315 00000100:00100000:2.0:1790740430.299537:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d8498d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5842:1877727158282624:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1790740430.300063:0:5842:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1790740430.300146:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d8498d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5842:1877727158282752:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1790740430.300215:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740430.300500:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d81324a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790740430.300716:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158282752 00000100:00100000:1.0:1790740430.300722:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158282752 00000100:00100000:1.0:1790740430.300755:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790740430.300763:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5842:x1877727158282752:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1790740430.301029:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5842:x1877727158282752:12345-0@lo:1000:mdt00_000.0 Request processed in 267us (813us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1790740430.301037:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790740430.301118:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d8498d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5842:1877727158282752:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1790740430.301150:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031800/0xc6b31a1b598ea87a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740430.301160:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031800/0xc6b31a1b598ea87a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740430.301168:0:5842:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031800/0xc6b31a1b598ea87a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740430.301174:0:5842:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d80031800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740430.301179:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031800/0xc6b31a1b598ea87a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740430.301188:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031800/0xc6b31a1b598ea87a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740430.301203:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8f0d84a1ec00) 00010000:00010000:2.0:1790740430.301206:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790740430.301211:0:5842:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031800/0xc6b31a1b598ea87a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740430.301216:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031800/0xc6b31a1b598ea87a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740430.301241:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e800/0xc6b31a1b598ea7b6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740430.301247:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e800/0xc6b31a1b598ea7b6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740430.301259:0:5842:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e800/0xc6b31a1b598ea7b6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740430.301264:0:5842:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0e800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740430.301266:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e800/0xc6b31a1b598ea7b6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740430.301272:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e800/0xc6b31a1b598ea7b6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740430.301281:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f0d944f6500) 00010000:00010000:2.0:1790740430.301284:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790740430.301287:0:5842:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e800/0xc6b31a1b598ea7b6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740430.301292:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e800/0xc6b31a1b598ea7b6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740430.301315:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea881 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740430.301328:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030c00/0xc6b31a1b598ea7d2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6ae expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740430.301337:0:5842:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea881 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740430.301369:0:5842:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030c00/0xc6b31a1b598ea7d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6ae expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740430.301393:0:5842:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030c00/0xc6b31a1b598ea7d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6ae expref: 21 pid: 5843 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740430.301406:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1c3d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1877727158282880:192.168.203.58@tcp:104: 00000100:00100000:2.0:1790740430.301475:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d81324a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790740430.305946:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740430.306172:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1c3d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1877727158282880:192.168.203.58@tcp:104: 00010000:00010000:3.0:1790740430.306197:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea881 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740430.307159:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133122560 00000100:00100000:1.0:1790740430.307167:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133122560 00010000:00010000:1.0:1790740430.307202:0:5830:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030c00/0xc6b31a1b598ea7d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6ae expref: 22 pid: 5843 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740430.307270:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 70 00000100:00100000:1.0:1790740430.307280:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec599375-3198-45fd-a23a-c5620f07177c+22:2369:x1877727133122560:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790740430.307302:0:5830:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740430.307308:0:5830:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030c00/0xc6b31a1b598ea7d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6ae expref: 22 pid: 5843 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740430.307320:0:5830:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030c00/0xc6b31a1b598ea7d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6ae expref: 22 pid: 5843 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740430.307343:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030c00/0xc6b31a1b598ea7d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6ae expref: 22 pid: 5843 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740430.307357:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f0d944f6500) 00010000:00010000:1.0:1790740430.307362:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea881 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740430.307372:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea881 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740430.307379:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea881 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740430.307408:0:5830:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740430.307468:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec599375-3198-45fd-a23a-c5620f07177c+21:2369:x1877727133122560:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 190us (1527us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740430.307476:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 70 00010000:00010000:3.0:1790740430.307545:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea881 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.307553:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea881 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.307564:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea881 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.307594:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea881 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.307607:0:5842:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea881 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.307612:0:5842:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87595800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1790740430.307616:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea881 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.307623:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea881 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.307632:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f0d944f6500) 00010000:00010000:3.0:1790740430.307635:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740430.308261:0:5842:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea881 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.308268:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598ea881 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.308281:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031600/0xc6b31a1b598ea873 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.308287:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031600/0xc6b31a1b598ea873 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.308292:0:5842:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031600/0xc6b31a1b598ea873 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.308297:0:5842:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d80031600 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1790740430.308300:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031600/0xc6b31a1b598ea873 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.308306:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031600/0xc6b31a1b598ea873 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.308315:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f0d944f6500) 00010000:00010000:3.0:1790740430.308318:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790740430.308321:0:5842:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031600/0xc6b31a1b598ea873 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.308327:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031600/0xc6b31a1b598ea873 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740430.308621:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8498ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+20:11509:x1877727133122304:12345-192.168.203.58@tcp:57:lhsmtool_posix.0 Request processed in 17415us (17638us total) trans 4294967466 rc 0/0 00000100:00100000:3.0:1790740430.308631:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 185 00000020:00080000:3.0:1790740430.308643:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1790740430.309132:0:11679:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790740430.309137:0:11679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1790740430.310806:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740430.310838:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133122816 00000100:00100000:3.0:1790740430.310847:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133122816 00000100:00100000:3.0:1790740430.310892:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 50 00000100:00100000:3.0:1790740430.310902:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0da2039850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+20:11509:x1877727133122816:12345-192.168.203.58@tcp:35:lhsmtool_posix.0 00000040:00080000:0.0:1790740430.311198:0:11679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1790740430.311211:0:11679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000004:00080000:3.0:1790740430.311565:0:5846:0:(mdd_object.c:4180:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1790740430.311694:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:3.0:1790740430.311740:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fc00/0xc6b31a1b598ea888 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.311756:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fc00/0xc6b31a1b598ea888 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.311768:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fc00/0xc6b31a1b598ea888 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.311776:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fc00/0xc6b31a1b598ea888 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.311781:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fc00/0xc6b31a1b598ea888 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.311787:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fc00/0xc6b31a1b598ea888 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.311809:0:5846:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1790740430.311888:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0da2039850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+22:11509:x1877727133122816:12345-192.168.203.58@tcp:35:lhsmtool_posix.0 Request processed in 987us (1087us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1790740430.311896:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 50 00000020:00080000:3.0:1790740430.311902:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790740430.311922:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790740430.311931:0:5832:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fc00/0xc6b31a1b598ea888 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740430.312202:0:5832:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0fc00 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:0.0:1790740430.312206:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fc00/0xc6b31a1b598ea888 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740430.312215:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fc00/0xc6b31a1b598ea888 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740430.312227:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8f0d944f6400) 00010000:00010000:0.0:1790740430.312230:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1790740430.312235:0:5832:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fc00/0xc6b31a1b598ea888 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740430.312241:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fc00/0xc6b31a1b598ea888 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740430.312258:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740430.312260:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740430.312261:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790740430.564944:0:12452:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790740430.564953:0:12452:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790740430.564998:0:12452:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:0.0:1790740430.565005:0:12452:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790740430.687958:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740430.692261:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133123072 00000100:00100000:1.0:1790740430.692275:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133123072 00000100:00100000:1.0:1790740430.692352:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 186 00000100:00100000:1.0:1790740430.692363:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+22:11519:x1877727133123072:12345-192.168.203.58@tcp:101:lfs.0 00010000:00010000:1.0:1790740430.692399:0:5844:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740430.692421:0:5844:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031800/0xc6b31a1b598ea88f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee6e6 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740430.692514:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031200/0xc6b31a1b598ea896 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740430.692529:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031200/0xc6b31a1b598ea896 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740430.692542:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031200/0xc6b31a1b598ea896 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790740430.692553:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1790740430.693401:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031800/0xc6b31a1b598ea88f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6e6 expref: 25 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740430.693421:0:5844:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031200/0xc6b31a1b598ea896 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6e6 expref: 24 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740430.693431:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f0d98dccd00) 00010000:00010000:1.0:1790740430.693434:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790740430.693437:0:5844:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d80031200, rc 0) 00000100:00100000:1.0:1790740430.693502:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+24:11519:x1877727133123072:12345-192.168.203.58@tcp:101:lfs.0 Request processed in 1140us (5551us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1790740430.693510:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 186 00000100:00100000:3.0:1790740430.697478:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740430.699345:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133123200 00000100:00100000:1.0:1790740430.699358:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133123200 00000100:00100000:3.0:1790740430.700194:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 187 00000100:00100000:3.0:1790740430.700206:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+24:11519:x1877727133123200:12345-192.168.203.58@tcp:34:lfs.0 00010000:00010000:3.0:1790740430.700275:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598ea8a4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.700293:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598ea8a4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.700304:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598ea8a4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.700318:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea8ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.700485:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea8ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.700493:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea8ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.700829:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea8b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.700839:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea8b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.700847:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea8b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790740430.700886:0:5843:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea8b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.700906:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598ea8a4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.700914:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598ea8a4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.700921:0:5843:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598ea8a4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.701129:0:5843:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0f600 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1790740430.701134:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598ea8a4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.701144:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598ea8a4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.701158:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f0d98dccd00) 00010000:00010000:3.0:1790740430.701161:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740430.701167:0:5843:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598ea8a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.701174:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598ea8a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.701187:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea8ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.701193:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea8ab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.701200:0:5843:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea8ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.701212:0:5843:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0e000 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1790740430.701216:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea8ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.701222:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea8ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.701230:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8f0d944f6500) 00010000:00010000:3.0:1790740430.701233:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740430.701236:0:5843:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea8ab lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.701243:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea8ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.701257:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea8b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.701265:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea8b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.701271:0:5843:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea8b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.701276:0:5843:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0ee00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1790740430.701279:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea8b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.701286:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea8b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.701304:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f0d944f6700) 00010000:00010000:3.0:1790740430.701307:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740430.701310:0:5843:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea8b2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.701315:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea8b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740430.701798:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+24:11519:x1877727133123200:12345-192.168.203.58@tcp:34:lfs.0 Request processed in 1591us (4329us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740430.701808:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 187 00000100:00100000:2.0:1790740430.777691:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740430.777721:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133123456 00000100:00100000:2.0:1790740430.777729:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133123456 00000100:00100000:2.0:1790740430.777773:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 188 00000100:00100000:2.0:1790740430.777781:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+24:11522:x1877727133123456:12345-192.168.203.58@tcp:101:lfs.0 00010000:00010000:2.0:1790740430.777799:0:8666:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740430.777817:0:8666:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598ea8b9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee6ed expref: -99 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740430.777878:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea8c0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740430.777892:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea8c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740430.777904:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea8c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740430.777917:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea8c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740430.777923:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea8c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740430.777936:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea8c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740430.778180:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea8ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740430.778188:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea8ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740430.778195:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea8ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740430.778203:0:8666:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1790740430.778288:0:8666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea8c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740430.778297:0:8666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea8c0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740430.778304:0:8666:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea8c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740430.778310:0:8666:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87594200 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740430.778314:0:8666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea8c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740430.778333:0:8666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea8c0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740430.778345:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f0d98dccd00) 00010000:00010000:2.0:1790740430.778349:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740430.778360:0:8666:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea8c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740430.778367:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598ea8c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740430.778378:0:8666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea8c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740430.778384:0:8666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea8c7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740430.778389:0:8666:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea8c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740430.778394:0:8666:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87594e00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740430.778396:0:8666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea8c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740430.778401:0:8666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea8c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740430.778407:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8f0d98dcc000) 00010000:00010000:2.0:1790740430.778409:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740430.778412:0:8666:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea8c7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740430.778417:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea8c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740430.778452:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598ea8b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6ed expref: 27 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740430.778479:0:8666:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea8ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6ed expref: 26 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740430.778486:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f0d98dcce00) 00010000:00010000:2.0:1790740430.778488:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790740430.778490:0:8666:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d87594800, rc 0) 00000100:00100000:2.0:1790740430.778548:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+26:11522:x1877727133123456:12345-192.168.203.58@tcp:101:lfs.0 Request processed in 767us (863us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1790740430.778557:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 188 00000100:00100000:0.0:1790740430.790193:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740430.790230:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133123584 00000100:00100000:0.0:1790740430.790239:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133123584 00000100:00100000:0.0:1790740430.790288:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 189 00000100:00100000:0.0:1790740430.790297:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc12e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+26:11522:x1877727133123584:12345-192.168.203.58@tcp:54:lfs.0 00010000:00010000:0.0:1790740430.790367:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f200/0xc6b31a1b598ea8dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740430.790384:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f200/0xc6b31a1b598ea8dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740430.790397:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f200/0xc6b31a1b598ea8dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740430.790423:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f200/0xc6b31a1b598ea8dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740430.790429:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f200/0xc6b31a1b598ea8dc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740430.790436:0:5842:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f200/0xc6b31a1b598ea8dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740430.790441:0:5842:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132f200 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1790740430.790445:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f200/0xc6b31a1b598ea8dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740430.790452:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f200/0xc6b31a1b598ea8dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740430.790463:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f0d98dcce00) 00010000:00010000:0.0:1790740430.790466:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790740430.790471:0:5842:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f200/0xc6b31a1b598ea8dc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740430.790477:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f200/0xc6b31a1b598ea8dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740430.790549:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc12e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+26:11522:x1877727133123584:12345-192.168.203.58@tcp:54:lfs.0 Request processed in 252us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740430.790556:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 189 00000100:00100000:3.0:1790740430.794645:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740430.794679:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133123840 00000100:00100000:3.0:1790740430.794688:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133123840 00000100:00100000:3.0:1790740430.794734:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 51 00000100:00100000:3.0:1790740430.794743:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+26:11522:x1877727133123840:12345-192.168.203.58@tcp:35:lfs.0 00000100:00100000:3.0:1790740430.794945:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+27:11522:x1877727133123840:12345-192.168.203.58@tcp:35:lfs.0 Request processed in 202us (307us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1790740430.794952:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 51 00000100:00100000:0.0:1790740430.858402:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740430.858499:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133124096 00000100:00100000:2.0:1790740430.858509:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133124096 00000100:00100000:2.0:1790740430.858568:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 190 00000100:00100000:2.0:1790740430.858623:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc12e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+27:11057:x1877727133124096:12345-192.168.203.58@tcp:101:bash.0 00010000:00010000:2.0:1790740430.858647:0:8666:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740430.858667:0:8666:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598ea8e3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee6f4 expref: -99 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740430.858761:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea8ea lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740430.858777:0:8666:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea8ce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6ed expref: 28 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740430.858787:0:8666:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea8ea lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740430.858823:0:8666:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea8ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6ed expref: 28 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740430.858849:0:8666:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea8ce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6ed expref: 28 pid: 8666 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740430.858864:0:8666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1c3ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8666:1877727158283008:192.168.203.58@tcp:104: 00000100:00100000:2.0:1790740430.858961:0:8666:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d81324180 going to sleep for 11 seconds 00000100:00100000:3.0:1790740430.862234:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740430.862332:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133124224 00000100:00100000:1.0:1790740430.862353:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133124224 00010000:00010000:1.0:1790740430.862392:0:5829:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea8ce lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6ed expref: 29 pid: 8666 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740430.862425:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 71 00000100:00100000:1.0:1790740430.862435:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec599375-3198-45fd-a23a-c5620f07177c+29:2369:x1877727133124224:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790740430.862450:0:5829:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740430.862457:0:5829:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea8ce lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6ed expref: 29 pid: 8666 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740430.862468:0:5829:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea8ce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6ed expref: 29 pid: 8666 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740430.862488:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f0d98dcce00) 00010000:00010000:1.0:1790740430.862494:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea8ea lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740430.862503:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea8ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740430.862511:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea8ea lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740430.862529:0:5829:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740430.862606:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec599375-3198-45fd-a23a-c5620f07177c+29:2369:x1877727133124224:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 172us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740430.862614:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 71 00010000:00010000:2.0:1790740430.862863:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598ea8ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6ed expref: 28 pid: 8666 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740430.862880:0:8666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1c3ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8666:1877727158283008:192.168.203.58@tcp:104: 00010000:00010000:2.0:1790740430.862899:0:8666:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea8ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740430.862907:0:8666:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea8ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740430.862913:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea8ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740430.862930:0:8666:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1790740430.863061:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598ea8e3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6f4 expref: 29 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740430.863089:0:8666:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea8ea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6f4 expref: 28 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740430.863097:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f0d98dcce00) 00010000:00010000:2.0:1790740430.863106:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790740430.863110:0:8666:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d87594e00, rc 0) 00000100:00100000:2.0:1790740430.863151:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc12e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+28:11057:x1877727133124096:12345-192.168.203.58@tcp:101:bash.0 Request processed in 4531us (4758us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1790740430.863159:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 190 00000100:00100000:3.0:1790740430.867442:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740430.868831:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133124480 00000100:00100000:0.0:1790740430.868844:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133124480 00000100:00100000:0.0:1790740430.869262:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 191 00000100:00100000:0.0:1790740430.869277:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+28:11057:x1877727133124480:12345-192.168.203.58@tcp:36:bash.0 00010000:00010000:0.0:1790740430.870325:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f600/0xc6b31a1b598ea8f8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740430.870345:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f600/0xc6b31a1b598ea8f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740430.870356:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f600/0xc6b31a1b598ea8f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790740430.870428:0:5842:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:0.0:1790740430.870461:0:5842:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000efad9b0f reply state 0000000019e1e8db transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f600/0xc6b31a1b598ea8f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740430.870471:0:5842:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1790740430.870882:0:5842:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:0.0:1790740430.871387:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+32:11057:x1877727133124480:12345-192.168.203.58@tcp:36:bash.0 Request processed in 2110us (3951us total) trans 4294967475 rc 0/0 00000100:00100000:0.0:1790740430.871396:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 191 00000020:00080000:0.0:1790740430.871403:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1790740430.874772:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f600/0xc6b31a1b598ea8f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740430.874801:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f600/0xc6b31a1b598ea8f8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740430.874810:0:3289:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f600/0xc6b31a1b598ea8f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740430.874817:0:3289:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132f600 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1790740430.874823:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f600/0xc6b31a1b598ea8f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740430.874830:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f600/0xc6b31a1b598ea8f8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740430.874848:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f0d98dcce00) 00010000:00010000:0.0:1790740430.874851:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740430.874856:0:3289:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f600/0xc6b31a1b598ea8f8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740430.874863:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f600/0xc6b31a1b598ea8f8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740430.875798:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740430.876006:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133124608 00000100:00100000:1.0:1790740430.876016:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133124608 00000100:00100000:1.0:1790740430.876089:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 192 00000100:00100000:1.0:1790740430.876099:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+31:11057:x1877727133124608:12345-192.168.203.58@tcp:101:bash.0 00010000:00010000:1.0:1790740430.876124:0:5844:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740430.876142:0:5844:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030600/0xc6b31a1b598ea8ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee6fb expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740430.876204:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030600/0xc6b31a1b598ea8ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6fb expref: 32 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740430.876217:0:5844:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030600/0xc6b31a1b598ea8ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6fb expref: 32 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740430.876235:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f0d98dcce00) 00010000:00010000:1.0:1790740430.876238:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790740430.876241:0:5844:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d80030600, rc 0) 00000100:00100000:1.0:1790740430.876302:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+32:11057:x1877727133124608:12345-192.168.203.58@tcp:101:bash.0 Request processed in 204us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740430.876309:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 192 00000100:00100000:3.0:1790740430.883431:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740430.883726:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133124736 00000100:00100000:1.0:1790740430.883736:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133124736 00000100:00100000:1.0:1790740430.883795:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 58 00000100:00100000:1.0:1790740430.883805:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec599375-3198-45fd-a23a-c5620f07177c+7:11057:x1877727133124736:12345-192.168.203.58@tcp:101:bash.0 00010000:00010000:1.0:1790740430.883822:0:6699:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740430.883843:0:6699:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be67bec2/0xc6b31a1b598ea906 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee702 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790740430.883869:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6abc87cd, atime: 0x6abc87cb, ctime: 0x6abc87cd, blocks: 0xb 00010000:00010000:1.0:1790740430.883906:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=346s v=(0 0) 00010000:00010000:1.0:1790740430.883912:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790740430.883977:0:6699:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be67bec2/0xc6b31a1b598ea906 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee702 expref: 8 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740430.883996:0:6699:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000be67bec2/0xc6b31a1b598ea906 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee702 expref: 8 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740430.884009:0:6699:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d80030a00, rc 0) 00000100:00100000:1.0:1790740430.884083:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec599375-3198-45fd-a23a-c5620f07177c+8:11057:x1877727133124736:12345-192.168.203.58@tcp:101:bash.0 Request processed in 278us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740430.884090:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 58 00000100:00100000:0.0:1790740430.890371:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740430.898078:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133124864 00000100:00100000:2.0:1790740430.898094:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133124864 00002000:00010000:2.0:1790740430.898141:0:6706:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1790740430.898146:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f0dc12e4000 with x1877727133124864 ext(0->18446744073709551615) 00002000:00010000:2.0:1790740430.898158:0:6706:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f0dc12e4000. 00000100:00100000:2.0:1790740430.898196:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 5 00000100:00100000:2.0:1790740430.898205:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc12e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ec599375-3198-45fd-a23a-c5620f07177c+8:2369:x1877727133124864:12345-192.168.203.58@tcp:10:bash.0 00002000:00010000:2.0:1790740430.898463:0:6706:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1790740430.898466:0:6706:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1790740429 -> 1790740430 00002000:00010000:2.0:1790740430.898469:0:6706:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1790740427 -> 1790740427 00002000:00010000:2.0:1790740430.898471:0:6706:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1790740429 -> 1790740430 00002000:00010000:2.0:1790740430.898473:0:6706:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1790740430.898534:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc12e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ec599375-3198-45fd-a23a-c5620f07177c+9:2369:x1877727133124864:12345-192.168.203.58@tcp:10:bash.0 Request processed in 329us (8172us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1790740430.898542:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 5 00002000:00010000:2.0:1790740430.898545:0:6706:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1790740430.898548:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f0dc12e4000 with x1877727133124864 ext(0->18446744073709551615) 00002000:00010000:2.0:1790740430.898553:0:6706:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f0dc12e4000. 00000100:00100000:0.0:1790740430.999170:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740430.999286:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133124992 00000100:00100000:3.0:1790740430.999296:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133124992 00000100:00100000:3.0:1790740430.999366:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 193 00000100:00100000:3.0:1790740430.999376:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc12e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+32:11536:x1877727133124992:12345-192.168.203.58@tcp:34:lfs.0 00010000:00010000:3.0:1790740430.999463:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea90d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.999480:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea90d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.999491:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea90d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.999506:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea914 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.999513:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea914 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.999519:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea914 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.999782:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598ea91b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.999792:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598ea91b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.999799:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598ea91b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790740430.999834:0:5843:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598ea91b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.999846:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea90d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.999869:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea90d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.999876:0:5843:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea90d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.999881:0:5843:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0ee00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1790740430.999886:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea90d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.999892:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea90d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.999903:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f0d98dccd00) 00010000:00010000:3.0:1790740430.999907:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740430.999911:0:5843:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea90d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.999916:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea90d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.999931:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea914 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.999937:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea914 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.999943:0:5843:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea914 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.999947:0:5843:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0e000 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1790740430.999956:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea914 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.999962:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea914 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.999971:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8f0d944f6700) 00010000:00010000:3.0:1790740430.999973:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740430.999976:0:5843:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea914 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.999981:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea914 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740430.999995:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598ea91b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.000001:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598ea91b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.000011:0:5843:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598ea91b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.000016:0:5843:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0f600 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1790740431.000018:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598ea91b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.000024:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598ea91b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.000031:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f0d98dcce00) 00010000:00010000:3.0:1790740431.000033:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740431.000042:0:5843:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598ea91b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.000048:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598ea91b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740431.000125:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc12e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+32:11536:x1877727133124992:12345-192.168.203.58@tcp:34:lfs.0 Request processed in 750us (961us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740431.000134:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 193 00000100:00100000:2.0:1790740431.062709:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740431.065219:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133125248 00000100:00100000:1.0:1790740431.065235:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133125248 00000100:00080000:2.0:1790740431.066129:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790740431.066514:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 194 00000100:00100000:1.0:1790740431.066531:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+32:11539:x1877727133125248:12345-192.168.203.58@tcp:101:lfs.0 00010000:00010000:1.0:1790740431.066551:0:5844:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740431.066588:0:5844:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031600/0xc6b31a1b598ea922 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee709 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740431.066659:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030c00/0xc6b31a1b598ea929 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740431.066674:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030c00/0xc6b31a1b598ea929 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740431.066688:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030c00/0xc6b31a1b598ea929 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740431.066722:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031800/0xc6b31a1b598ea930 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740431.066730:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031800/0xc6b31a1b598ea930 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740431.066736:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031800/0xc6b31a1b598ea930 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740431.067053:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea937 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740431.067063:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea937 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740431.067080:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea937 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790740431.067090:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1790740431.067178:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030c00/0xc6b31a1b598ea929 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740431.067186:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030c00/0xc6b31a1b598ea929 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740431.067192:0:5844:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030c00/0xc6b31a1b598ea929 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740431.067198:0:5844:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d80030c00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1790740431.067203:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030c00/0xc6b31a1b598ea929 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740431.067222:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030c00/0xc6b31a1b598ea929 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740431.067233:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f0d98dccd00) 00010000:00010000:1.0:1790740431.067237:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740431.067242:0:5844:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030c00/0xc6b31a1b598ea929 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740431.067248:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030c00/0xc6b31a1b598ea929 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740431.067262:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031800/0xc6b31a1b598ea930 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740431.067268:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031800/0xc6b31a1b598ea930 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740431.067274:0:5844:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031800/0xc6b31a1b598ea930 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740431.067278:0:5844:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d80031800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1790740431.067281:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031800/0xc6b31a1b598ea930 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740431.067287:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031800/0xc6b31a1b598ea930 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740431.067294:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8f0d84a1e200) 00010000:00010000:1.0:1790740431.067296:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740431.067299:0:5844:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031800/0xc6b31a1b598ea930 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740431.067315:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031800/0xc6b31a1b598ea930 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740431.067356:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031600/0xc6b31a1b598ea922 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee709 expref: 35 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740431.067369:0:5844:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea937 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee709 expref: 34 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740431.067376:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f0d98dcce00) 00010000:00010000:1.0:1790740431.067378:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1790740431.067381:0:5844:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9f976000, rc 0) 00000100:00100000:1.0:1790740431.067455:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+34:11539:x1877727133125248:12345-192.168.203.58@tcp:101:lfs.0 Request processed in 930us (4752us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1790740431.067462:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 194 00000100:00100000:3.0:1790740431.074163:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740431.076492:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133125376 00000100:00100000:0.0:1790740431.076505:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133125376 00000100:00100000:0.0:1790740431.076645:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 195 00000100:00100000:0.0:1790740431.076657:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1a42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+34:11539:x1877727133125376:12345-192.168.203.58@tcp:54:lfs.0 00010000:00010000:0.0:1790740431.076728:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e400/0xc6b31a1b598ea945 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740431.076773:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea8ea lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6f4 expref: 34 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740431.076784:0:5843:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e400/0xc6b31a1b598ea945 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740431.076819:0:5843:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea8ea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6f4 expref: 34 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740431.076833:0:5843:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea8ea lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6f4 expref: 34 pid: 8666 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740431.076847:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc12e6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1877727158283136:192.168.203.58@tcp:104: 00000100:00100000:0.0:1790740431.076941:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0dbec32600 going to sleep for 11 seconds 00000100:00100000:3.0:1790740431.084550:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc12e6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1877727158283136:192.168.203.58@tcp:104: 00000100:00100000:0.0:1790740431.085332:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00010000:00010000:3.0:1790740431.085464:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e400/0xc6b31a1b598ea945 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740431.085706:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133125632 00000100:00100000:1.0:1790740431.085714:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133125632 00000100:00100000:1.0:1790740431.085759:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 52 00000100:00100000:1.0:1790740431.085769:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc12e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+35:5608:x1877727133125632:12345-192.168.203.58@tcp:35:ldlm_bl.0 00000001:00080000:1.0:1790740431.086008:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967477 00000100:00100000:1.0:1790740431.086129:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc12e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+37:5608:x1877727133125632:12345-192.168.203.58@tcp:35:ldlm_bl.0 Request processed in 360us (798us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1790740431.086137:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 52 00000020:00080000:1.0:1790740431.086143:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1790740431.090519:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740431.090618:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133125760 00000100:00100000:2.0:1790740431.090644:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133125760 00010000:00010000:2.0:1790740431.090700:0:5828:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea8ea lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6f4 expref: 37 pid: 8666 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740431.090840:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 72 00000100:00100000:2.0:1790740431.090859:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc12e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec599375-3198-45fd-a23a-c5620f07177c+37:2369:x1877727133125760:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790740431.090875:0:5828:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740431.090882:0:5828:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea8ea lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6f4 expref: 37 pid: 8666 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.090895:0:5828:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea8ea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6f4 expref: 37 pid: 8666 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.090915:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598ea8ea lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6f4 expref: 37 pid: 8666 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.090939:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f0d98dcce00) 00010000:00010000:2.0:1790740431.090945:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e400/0xc6b31a1b598ea945 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.090955:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e400/0xc6b31a1b598ea945 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.090963:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e400/0xc6b31a1b598ea945 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.090992:0:5828:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790740431.091168:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e400/0xc6b31a1b598ea945 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.091177:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e400/0xc6b31a1b598ea945 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.091215:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e400/0xc6b31a1b598ea945 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.091222:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e400/0xc6b31a1b598ea945 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.091229:0:5843:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e400/0xc6b31a1b598ea945 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.091235:0:5843:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132e400 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1790740431.091239:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e400/0xc6b31a1b598ea945 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.091254:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e400/0xc6b31a1b598ea945 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.091263:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f0d98dcce00) 00010000:00010000:3.0:1790740431.091266:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790740431.091269:0:5843:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e400/0xc6b31a1b598ea945 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.091275:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e400/0xc6b31a1b598ea945 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740431.091646:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc12e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec599375-3198-45fd-a23a-c5620f07177c+36:2369:x1877727133125760:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 788us (1136us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740431.091849:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1a42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+36:11539:x1877727133125376:12345-192.168.203.58@tcp:54:lfs.0 Request processed in 15194us (17694us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740431.091858:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 195 00000100:00100000:2.0:1790740431.094853:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 72 00000100:00100000:3.0:1790740431.097159:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740431.097302:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133126016 00000100:00100000:0.0:1790740431.097312:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133126016 00000100:00100000:0.0:1790740431.097371:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 53 00000100:00100000:0.0:1790740431.097381:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec599375-3198-45fd-a23a-c5620f07177c+35:11539:x1877727133126016:12345-192.168.203.58@tcp:35:lfs.0 00000100:00100000:0.0:1790740431.097698:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec599375-3198-45fd-a23a-c5620f07177c+36:11539:x1877727133126016:12345-192.168.203.58@tcp:35:lfs.0 Request processed in 318us (546us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1790740431.097707:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 53 00010000:00010000:1.0:1790740431.152834:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740431.183220:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740431.183454:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133126272 00000100:00100000:3.0:1790740431.183464:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133126272 00000100:00100000:3.0:1790740431.183525:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 196 00000100:00100000:3.0:1790740431.183535:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc12e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+36:11550:x1877727133126272:12345-192.168.203.58@tcp:101:cat.0 00010000:00010000:3.0:1790740431.183559:0:8666:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740431.183613:0:8666:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598ea94c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee710 expref: -99 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.183694:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea953 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.183710:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea953 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.183739:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea953 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.183756:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea95a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.183763:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea95a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.183770:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea95a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.184016:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fc00/0xc6b31a1b598ea961 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.184026:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fc00/0xc6b31a1b598ea961 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.184034:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fc00/0xc6b31a1b598ea961 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790740431.184044:0:8666:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:3.0:1790740431.184144:0:8666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea953 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.184152:0:8666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea953 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.184160:0:8666:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea953 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.184182:0:8666:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0e000 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1790740431.184192:0:8666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea953 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.184209:0:8666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea953 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.184223:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f0d98dccd00) 00010000:00010000:3.0:1790740431.184226:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740431.184231:0:8666:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea953 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.184238:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea953 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.184252:0:8666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea95a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.184259:0:8666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea95a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.184264:0:8666:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea95a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.184269:0:8666:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0ee00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1790740431.184272:0:8666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea95a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.184279:0:8666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea95a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.184287:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8f0d944f6700) 00010000:00010000:3.0:1790740431.184289:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740431.184299:0:8666:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea95a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.184307:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea95a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.184346:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598ea94c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee710 expref: 39 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.184360:0:8666:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fc00/0xc6b31a1b598ea961 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee710 expref: 38 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.184368:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f0d98dcce00) 00010000:00010000:3.0:1790740431.184370:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790740431.184372:0:8666:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0db6c0fc00, rc 0) 00000100:00100000:3.0:1790740431.184435:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc12e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+38:11550:x1877727133126272:12345-192.168.203.58@tcp:101:cat.0 Request processed in 901us (1232us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1790740431.184444:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 196 00000100:00100000:1.0:1790740431.199166:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740431.199268:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133126528 00000100:00100000:3.0:1790740431.199278:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133126528 00000100:00100000:3.0:1790740431.199334:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 54 00000100:00100000:3.0:1790740431.199344:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+38:11550:x1877727133126528:12345-192.168.203.58@tcp:35:cat.0 00000100:00100000:3.0:1790740431.199624:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+39:11550:x1877727133126528:12345-192.168.203.58@tcp:35:cat.0 Request processed in 280us (466us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1790740431.199631:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 54 00000100:00100000:2.0:1790740431.231986:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740431.232183:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133126784 00000100:00100000:0.0:1790740431.232193:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133126784 00000100:00100000:0.0:1790740431.232272:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 197 00000100:00100000:0.0:1790740431.232282:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+39:11551:x1877727133126784:12345-192.168.203.58@tcp:36:rm.0 00010000:00010000:0.0:1790740431.232340:0:5842:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1790740431.232365:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fc00/0xc6b31a1b598ea961 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee710 expref: 39 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740431.232387:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598ea937 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee709 expref: 38 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740431.232402:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80030600/0xc6b31a1b598ea8ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6fb expref: 37 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740431.232412:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f0d98dcce00) 00010000:00010000:0.0:1790740431.232421:0:5842:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790740431.232439:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e000/0xc6b31a1b598ea96f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740431.232451:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e000/0xc6b31a1b598ea96f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740431.232459:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e000/0xc6b31a1b598ea96f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740431.232471:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea976 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740431.232478:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea976 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740431.232495:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea976 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740431.232740:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e200/0xc6b31a1b598ea97d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740431.232748:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e200/0xc6b31a1b598ea97d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740431.232755:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e200/0xc6b31a1b598ea97d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790740431.233875:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:0.0:1790740431.233886:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 347184312679ns, next at 348184310421ns, rc = 0 00010000:00010000:0.0:1790740431.236287:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fc00/0xc6b31a1b598ea984 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740431.236308:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fc00/0xc6b31a1b598ea984 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740431.236319:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fc00/0xc6b31a1b598ea984 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740431.236328:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fc00/0xc6b31a1b598ea984 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740431.236334:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fc00/0xc6b31a1b598ea984 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740431.236340:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fc00/0xc6b31a1b598ea984 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740431.236353:0:5842:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790740431.236376:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e200/0xc6b31a1b598ea97d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740431.236395:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e200/0xc6b31a1b598ea97d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740431.236401:0:5842:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e200/0xc6b31a1b598ea97d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740431.236407:0:5842:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132e200 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1790740431.236412:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e200/0xc6b31a1b598ea97d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740431.236420:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e200/0xc6b31a1b598ea97d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740431.236432:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f0d82841600) 00010000:00010000:0.0:1790740431.236435:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1790740431.236439:0:5842:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e200/0xc6b31a1b598ea97d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740431.236445:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e200/0xc6b31a1b598ea97d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740431.236464:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e000/0xc6b31a1b598ea96f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740431.236469:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e000/0xc6b31a1b598ea96f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740431.236474:0:5842:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e000/0xc6b31a1b598ea96f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740431.236479:0:5842:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132e000 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1790740431.236529:0:11661:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790740431.236537:0:11661:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fc00/0xc6b31a1b598ea984 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740431.236544:0:11661:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132fc00 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:1.0:1790740431.236548:0:11661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fc00/0xc6b31a1b598ea984 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740431.236554:0:11661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fc00/0xc6b31a1b598ea984 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740431.236563:0:11661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f0d82841600) 00010000:00010000:1.0:1790740431.236566:0:11661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1790740431.236589:0:11661:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fc00/0xc6b31a1b598ea984 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740431.236596:0:11661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fc00/0xc6b31a1b598ea984 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740431.236615:0:11661:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740431.236617:0:11661:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740431.236620:0:11661:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740431.236860:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e000/0xc6b31a1b598ea96f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740431.236867:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e000/0xc6b31a1b598ea96f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740431.236876:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f0d98dccd00) 00010000:00010000:0.0:1790740431.236879:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740431.236882:0:5842:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e000/0xc6b31a1b598ea96f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740431.236889:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e000/0xc6b31a1b598ea96f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790740431.236899:0:5842:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000001b94389 reply state 0000000016e8448f transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea976 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740431.236908:0:5842:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790740431.237017:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+38:11551:x1877727133126784:12345-192.168.203.58@tcp:36:rm.0 Request processed in 4733us (5035us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1790740431.237027:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 197 00010000:00010000:2.0:1790740431.247236:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea976 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.247253:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea976 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.247261:0:3290:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea976 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.247266:0:3290:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132f800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740431.247271:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea976 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.247278:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea976 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.247293:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8f0d82841b00) 00010000:00010000:2.0:1790740431.247296:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740431.247301:0:3290:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea976 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.247306:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f800/0xc6b31a1b598ea976 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740431.327506:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740431.327895:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133127040 00000100:00100000:3.0:1790740431.327905:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133127040 00000100:00100000:3.0:1790740431.327975:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 198 00000100:00100000:3.0:1790740431.327985:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1c3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+37:11557:x1877727133127040:12345-192.168.203.58@tcp:101:bash.0 00010000:00010000:3.0:1790740431.328032:0:8666:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740431.328054:0:8666:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598ea98b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee717 expref: -99 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.328210:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea992 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.328228:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea992 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.328241:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea992 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.328256:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea999 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.328262:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea999 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.328269:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea999 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790740431.329954:0:8666:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1790740431.330617:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e800/0xc6b31a1b598ea9a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.330635:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e800/0xc6b31a1b598ea9a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.330715:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e800/0xc6b31a1b598ea9a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.330839:0:8666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea992 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.330846:0:8666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea992 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.330853:0:8666:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea992 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.330859:0:8666:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0ee00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1790740431.330863:0:8666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea992 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.330870:0:8666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea992 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.330883:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f0d98dccd00) 00010000:00010000:3.0:1790740431.330886:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740431.330891:0:8666:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea992 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.330896:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea992 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790740431.330910:0:8666:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e5348b96 reply state 000000004961361b transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea999 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740431.330987:0:8666:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1790740431.331085:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598ea98b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee717 expref: 40 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.331165:0:8666:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e800/0xc6b31a1b598ea9a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee717 expref: 39 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.331173:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f0d944f6500) 00010000:00010000:3.0:1790740431.331176:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790740431.331178:0:8666:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0db6c0e800, rc 0) 00000100:00100000:3.0:1790740431.331331:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1c3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+40:11557:x1877727133127040:12345-192.168.203.58@tcp:101:bash.0 Request processed in 3346us (3832us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1790740431.331340:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 198 00010000:00010000:0.0:1790740431.343308:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea999 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740431.343326:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea999 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740431.343333:0:3289:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea999 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740431.343339:0:3289:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0e000 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1790740431.343344:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea999 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740431.343367:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea999 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740431.343383:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8f0d944f6700) 00010000:00010000:0.0:1790740431.343387:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740431.343391:0:3289:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea999 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740431.343398:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e000/0xc6b31a1b598ea999 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740431.343771:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740431.344260:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133127168 00000100:00100000:0.0:1790740431.344270:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133127168 00000100:00100000:0.0:1790740431.344327:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 59 00000100:00100000:0.0:1790740431.344337:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec599375-3198-45fd-a23a-c5620f07177c+5:2372:x1877727133127168:12345-192.168.203.58@tcp:101:bash.0 00010000:00010000:0.0:1790740431.344353:0:6701:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740431.344373:0:6701:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085209935/0xc6b31a1b598ea9ae lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee71e expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790740431.344399:0:6701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790740431.344418:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=347s v=(0 0) 00010000:00010000:0.0:1790740431.344421:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740431.344431:0:6701:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085209935/0xc6b31a1b598ea9ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee71e expref: 6 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740431.344947:0:6701:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000085209935/0xc6b31a1b598ea9ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee71e expref: 6 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740431.344978:0:6701:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0dc132e000, rc 0) 00000100:00100000:0.0:1790740431.345033:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec599375-3198-45fd-a23a-c5620f07177c+6:2372:x1877727133127168:12345-192.168.203.58@tcp:101:bash.0 Request processed in 697us (1266us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740431.345041:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 59 00000100:00080000:1.0:1790740431.345495:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790740431.350100:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740431.350167:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133127296 00000100:00100000:0.0:1790740431.350178:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133127296 00000100:00100000:0.0:1790740431.350237:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 60 00000100:00100000:0.0:1790740431.350248:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec599375-3198-45fd-a23a-c5620f07177c+6:11557:x1877727133127296:12345-192.168.203.58@tcp:101:bash.0 00010000:00010000:0.0:1790740431.350266:0:6699:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740431.350283:0:6699:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005859c61d/0xc6b31a1b598ea9b5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee725 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740431.350330:0:6699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000085209935/0xc6b31a1b598ea9ae lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee71e expref: 7 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740431.350341:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740431.350346:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740431.350352:0:6699:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005859c61d/0xc6b31a1b598ea9b5 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee725 expref: 7 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740431.350754:0:6699:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000085209935/0xc6b31a1b598ea9ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee71e expref: 7 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740431.350769:0:6699:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000085209935/0xc6b31a1b598ea9ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee71e expref: 7 pid: 6701 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740431.350799:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc12e6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6699:1877727158283264:192.168.203.58@tcp:104: 00000100:00100000:0.0:1790740431.350903:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0dbec329c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790740431.357635:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740431.357721:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc12e6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6699:1877727158283264:192.168.203.58@tcp:104: 00010000:00010000:0.0:1790740431.357749:0:6699:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005859c61d/0xc6b31a1b598ea9b5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee725 expref: 7 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740431.357765:0:6699:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0dc132e200, rc 0) 00000100:00100000:0.0:1790740431.357816:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec599375-3198-45fd-a23a-c5620f07177c+7:11557:x1877727133127296:12345-192.168.203.58@tcp:101:bash.0 Request processed in 7572us (7789us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740431.357823:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 60 00000100:00100000:1.0:1790740431.358003:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133127424 00000100:00100000:1.0:1790740431.358015:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133127424 00010000:00010000:1.0:1790740431.358046:0:5829:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000085209935/0xc6b31a1b598ea9ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee71e expref: 7 pid: 6701 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740431.358123:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 73 00000100:00100000:1.0:1790740431.358146:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db5a69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec599375-3198-45fd-a23a-c5620f07177c+7:2369:x1877727133127424:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790740431.358159:0:5829:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740431.358179:0:5829:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000085209935/0xc6b31a1b598ea9ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee71e expref: 7 pid: 6701 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740431.358193:0:5829:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000085209935/0xc6b31a1b598ea9ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee71e expref: 7 pid: 6701 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740431.358217:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085209935/0xc6b31a1b598ea9ae lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee71e expref: 7 pid: 6701 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740431.358231:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790740431.358236:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790740431.358253:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005859c61d/0xc6b31a1b598ea9b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee725 expref: 6 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740431.358260:0:5829:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005859c61d/0xc6b31a1b598ea9b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee725 expref: 6 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740431.358287:0:5829:0:(ldlm_lockd.c:1085:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005859c61d/0xc6b31a1b598ea9b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee725 expref: 6 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740431.358301:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda77800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5829:1877727158283392:192.168.203.58@tcp:105: 00000100:00100000:1.0:1790740431.358363:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0c84c11a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790740431.368057:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740431.368152:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133127680 00000100:00100000:3.0:1790740431.368162:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133127680 00000100:00100000:3.0:1790740431.368214:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 55 00000100:00100000:3.0:1790740431.368224:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db5a6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+39:11557:x1877727133127680:12345-192.168.203.58@tcp:35:bash.0 00000100:00100000:3.0:1790740431.368568:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db5a6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+40:11557:x1877727133127680:12345-192.168.203.58@tcp:35:bash.0 Request processed in 344us (527us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1790740431.368607:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 55 00000100:00100000:1.0:1790740431.368887:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda77800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5829:1877727158283392:192.168.203.58@tcp:105: 00010000:00010000:1.0:1790740431.368921:0:5829:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740431.368945:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db5a69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec599375-3198-45fd-a23a-c5620f07177c+6:2369:x1877727133127424:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 10801us (11319us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740431.368954:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 73 00000100:00100000:2.0:1790740431.534501:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740431.534785:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133127808 00000100:00100000:3.0:1790740431.534795:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133127808 00000100:00100000:3.0:1790740431.534854:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 199 00000100:00100000:3.0:1790740431.534865:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db5a69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+40:11573:x1877727133127808:12345-192.168.203.58@tcp:101:lfs.0 00010000:00010000:3.0:1790740431.534888:0:5843:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740431.534908:0:5843:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598ea9bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee72c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.534982:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea9c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.535004:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea9c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.535016:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea9c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790740431.535052:0:5843:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1790740431.535056:0:5843:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790740431.535083:0:5843:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea9c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.535110:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598ea9bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee72c expref: 42 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.535129:0:5843:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea9c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee72c expref: 41 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.535138:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f0d98dccd00) 00010000:00010000:3.0:1790740431.535142:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790740431.535146:0:5843:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0db6c0ee00, rc 0) 00000100:00100000:3.0:1790740431.535208:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db5a69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+41:11573:x1877727133127808:12345-192.168.203.58@tcp:101:lfs.0 Request processed in 344us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740431.535215:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 199 00000100:00100000:2.0:1790740431.538885:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740431.539404:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133128064 00000100:00100000:1.0:1790740431.539415:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133128064 00000100:00100000:1.0:1790740431.539478:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 200 00000100:00100000:1.0:1790740431.539488:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db5a6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+41:11573:x1877727133128064:12345-192.168.203.58@tcp:101:lfs.0 00010000:00010000:1.0:1790740431.539509:0:5844:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740431.539529:0:5844:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea9ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee733 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740431.539862:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea9d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740431.539878:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea9d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740431.539889:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea9d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790740431.539900:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1790740431.540153:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598ea9ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee733 expref: 44 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740431.540177:0:5844:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea9d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee733 expref: 43 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740431.540186:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f0d944f6500) 00010000:00010000:1.0:1790740431.540196:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790740431.540201:0:5844:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9f977800, rc 0) 00000100:00100000:1.0:1790740431.540457:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db5a6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+43:11573:x1877727133128064:12345-192.168.203.58@tcp:101:lfs.0 Request processed in 970us (1581us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1790740431.540466:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 200 00000100:00100000:2.0:1790740431.544671:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740431.544779:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133128320 00000100:00100000:3.0:1790740431.544789:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133128320 00000100:00100000:2.0:1790740431.544832:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740431.544844:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 201 00000100:00100000:3.0:1790740431.544854:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8654ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+43:11573:x1877727133128320:12345-192.168.203.58@tcp:101:lfs.0 00010000:00010000:3.0:1790740431.544878:0:5843:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740431.544909:0:5843:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598ea9df lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee73a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.545004:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f800/0xc6b31a1b598ea9e6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.545021:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f800/0xc6b31a1b598ea9e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.545033:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f800/0xc6b31a1b598ea9e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790740431.545045:0:5843:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1790740431.545178:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598ea9df lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee73a expref: 46 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.545195:0:5843:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f800/0xc6b31a1b598ea9e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee73a expref: 45 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.545203:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f0d944f6500) 00010000:00010000:3.0:1790740431.545206:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1790740431.545209:0:5843:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0db6c0f800, rc 0) 00000100:00100000:3.0:1790740431.545279:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8654ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+45:11573:x1877727133128320:12345-192.168.203.58@tcp:101:lfs.0 Request processed in 426us (616us total) trans 4294967486 rc 0/0 00000100:00100000:3.0:1790740431.545287:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 201 00000100:00100000:1.0:1790740431.545792:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133128448 00000100:00100000:1.0:1790740431.545800:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133128448 00000100:00100000:1.0:1790740431.545845:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 15 00000100:00100000:1.0:1790740431.545854:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d86548380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec599375-3198-45fd-a23a-c5620f07177c+45:2370:x1877727133128448:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790740431.545865:0:5830:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740431.545880:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598ea9d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee733 expref: 45 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740431.545900:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f0d944f6500) 00010000:00010000:1.0:1790740431.545904:0:5830:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740431.545942:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d86548380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec599375-3198-45fd-a23a-c5620f07177c+44:2370:x1877727133128448:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 89us (1110us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740431.545949:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 15 00000100:00100000:2.0:1790740431.553493:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740431.553612:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133128576 00000100:00100000:0.0:1790740431.553623:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133128576 00000100:00100000:0.0:1790740431.553730:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 61 00000100:00100000:0.0:1790740431.553741:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d86548000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec599375-3198-45fd-a23a-c5620f07177c+6:2370:x1877727133128576:12345-192.168.203.58@tcp:1:lfs.0 00010000:00010000:0.0:1790740431.553787:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000963dbcd5/0xc6b31a1b598ea9f4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740431.553809:0:6701:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005859c61d/0xc6b31a1b598ea9b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee725 expref: 6 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740431.553818:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740431.553822:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790740431.553827:0:6701:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000963dbcd5/0xc6b31a1b598ea9f4 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740431.553878:0:6701:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005859c61d/0xc6b31a1b598ea9b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee725 expref: 6 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740431.553892:0:6701:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005859c61d/0xc6b31a1b598ea9b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee725 expref: 6 pid: 6699 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740431.553907:0:6701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc12e6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6701:1877727158283520:192.168.203.58@tcp:104: 00000100:00100000:0.0:1790740431.554007:0:6701:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0dbec329c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790740431.559693:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740431.559813:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133128704 00000100:00100000:3.0:1790740431.559822:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133128704 00002000:00100000:3.0:1790740431.559869:0:6707:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8f0dc1a3c000 x1877727133128704/t0(0) o4->ec599375-3198-45fd-a23a-c5620f07177c@192.168.203.58@tcp:487/0 lens 504/0 e 0 to 0 dl 1790740442 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790740431.559880:0:6707:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f0dc1a3c000 with x1877727133128704 ext(0->8) 00010000:00010000:3.0:1790740431.559900:0:6707:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000005859c61d/0xc6b31a1b598ea9b5 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee725 expref: 7 pid: 6699 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.559917:0:6707:0:(ldlm_lockd.c:610:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000005859c61d/0xc6b31a1b598ea9b5 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee725 expref: 7 pid: 6699 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790740431.559926:0:6707:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8f0dc1a3c000 00000100:00100000:3.0:1790740431.559961:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 3 00000100:00100000:3.0:1790740431.559970:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1a3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ec599375-3198-45fd-a23a-c5620f07177c+7:2370:x1877727133128704:12345-192.168.203.58@tcp:4:lfs.0 00000100:00100000:3.0:1790740431.560449:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1a3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ec599375-3198-45fd-a23a-c5620f07177c+9:2370:x1877727133128704:12345-192.168.203.58@tcp:4:lfs.0 Request processed in 479us (764us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1790740431.560458:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 3 00002000:00100000:3.0:1790740431.560466:0:6707:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8f0dc1a3c000 x1877727133128704/t4294967308(0) o4->ec599375-3198-45fd-a23a-c5620f07177c@192.168.203.58@tcp:487/0 lens 504/448 e 0 to 0 dl 1790740442 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790740431.560473:0:6707:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f0dc1a3c000 with x1877727133128704 ext(0->8) 00010000:00010000:3.0:1790740431.560479:0:6707:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000005859c61d/0xc6b31a1b598ea9b5 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee725 expref: 9 pid: 6699 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740431.560883:0:6701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc12e6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6701:1877727158283520:192.168.203.58@tcp:104: 00010000:00010000:1.0:1790740431.560906:0:6701:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000963dbcd5/0xc6b31a1b598ea9f4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.561389:0:6707:0:(ldlm_lockd.c:610:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000005859c61d/0xc6b31a1b598ea9b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee725 expref: 9 pid: 6699 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790740431.561400:0:6707:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8f0dc1a3c000 00000100:00100000:2.0:1790740431.566952:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740431.567365:0:8506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133128832 00000100:00100000:3.0:1790740431.567375:0:8506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133128832 00010000:00010000:3.0:1790740431.567415:0:8506:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005859c61d/0xc6b31a1b598ea9b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee725 expref: 9 pid: 6699 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740431.567614:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 74 00000100:00100000:3.0:1790740431.567625:0:8506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d87f2f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec599375-3198-45fd-a23a-c5620f07177c+9:2371:x1877727133128832:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790740431.567640:0:8506:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1790740431.567660:0:8506:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1790740431.567663:0:8506:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1790740431 00002000:00010000:3.0:1790740431.567665:0:8506:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1790740431 00002000:00010000:3.0:1790740431.567667:0:8506:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1790740431 00010000:00010000:3.0:1790740431.567673:0:8506:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005859c61d/0xc6b31a1b598ea9b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee725 expref: 9 pid: 6699 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.567688:0:8506:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005859c61d/0xc6b31a1b598ea9b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee725 expref: 9 pid: 6699 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.567885:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005859c61d/0xc6b31a1b598ea9b5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee725 expref: 9 pid: 6699 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.567903:0:8506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790740431.567907:0:8506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790740431.567913:0:8506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000963dbcd5/0xc6b31a1b598ea9f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.567923:0:8506:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000963dbcd5/0xc6b31a1b598ea9f4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.567957:0:8506:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790740431.568021:0:8506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d87f2f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec599375-3198-45fd-a23a-c5620f07177c+8:2371:x1877727133128832:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 397us (1078us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740431.568029:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 74 00010000:00010000:0.0:1790740431.568131:0:6701:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000963dbcd5/0xc6b31a1b598ea9f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740431.568141:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000963dbcd5/0xc6b31a1b598ea9f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740431.568167:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000963dbcd5/0xc6b31a1b598ea9f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740431.568176:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000963dbcd5/0xc6b31a1b598ea9f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740431.568185:0:6701:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000963dbcd5/0xc6b31a1b598ea9f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740431.568193:0:6701:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132fc00 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:0.0:1790740431.568204:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000963dbcd5/0xc6b31a1b598ea9f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740431.568214:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000963dbcd5/0xc6b31a1b598ea9f4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740431.568227:0:6701:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000963dbcd5/0xc6b31a1b598ea9f4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740431.568234:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000963dbcd5/0xc6b31a1b598ea9f4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740431.568286:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d86548000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec599375-3198-45fd-a23a-c5620f07177c+7:2370:x1877727133128576:12345-192.168.203.58@tcp:1:lfs.0 Request processed in 14547us (14813us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740431.568294:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 61 00000100:00100000:0.0:1790740431.571048:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740431.571131:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133129088 00000100:00100000:3.0:1790740431.571140:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133129088 00000100:00100000:3.0:1790740431.571195:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 56 00000100:00100000:3.0:1790740431.571205:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0da203b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec599375-3198-45fd-a23a-c5620f07177c+44:11573:x1877727133129088:12345-192.168.203.58@tcp:35:lfs.0 00000004:00010000:3.0:1790740431.571267:0:5845:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f800/0xc6b31a1b598ea9e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee73a expref: 44 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790740431.571934:0:5845:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1790740431.572215:0:5845:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:2.0:1790740431.572509:0:5845:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967489 00010000:00010000:2.0:1790740431.572562:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598ea9fb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.572826:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e800/0xc6b31a1b598ea9a0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee717 expref: 48 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.572837:0:5845:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598ea9fb lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.572875:0:5845:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e800/0xc6b31a1b598ea9a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee717 expref: 48 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.572891:0:5845:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e800/0xc6b31a1b598ea9a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee717 expref: 48 pid: 8666 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740431.572906:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a3ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5845:1877727158283648:192.168.203.58@tcp:104: 00000100:00100000:2.0:1790740431.573150:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d81324180 going to sleep for 11 seconds 00000100:00100000:3.0:1790740431.577377:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740431.577731:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a3ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5845:1877727158283648:192.168.203.58@tcp:104: 00010000:00010000:0.0:1790740431.577757:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598ea9fb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740431.577925:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133129216 00000100:00100000:1.0:1790740431.577931:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133129216 00010000:00010000:1.0:1790740431.577967:0:5830:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e800/0xc6b31a1b598ea9a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee717 expref: 49 pid: 8666 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740431.578111:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 75 00000100:00100000:1.0:1790740431.578122:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8498c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec599375-3198-45fd-a23a-c5620f07177c+49:2369:x1877727133129216:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790740431.578137:0:5830:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740431.578143:0:5830:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e800/0xc6b31a1b598ea9a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee717 expref: 49 pid: 8666 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740431.578155:0:5830:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e800/0xc6b31a1b598ea9a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee717 expref: 49 pid: 8666 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740431.578176:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e800/0xc6b31a1b598ea9a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee717 expref: 49 pid: 8666 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740431.578194:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f0d944f6500) 00010000:00010000:1.0:1790740431.578199:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598ea9fb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740431.578208:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598ea9fb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740431.578214:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598ea9fb lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740431.578236:0:5830:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740431.578280:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8498c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec599375-3198-45fd-a23a-c5620f07177c+48:2369:x1877727133129216:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 159us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740431.578295:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 75 00010000:00010000:0.0:1790740431.578346:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598ea9fb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740431.578354:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598ea9fb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790740431.578491:0:5845:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:0.0:1790740431.579037:0:5845:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:0.0:1790740431.579174:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc12e5f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1877727158283776:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1790740431.579228:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740431.579258:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0dbec329c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790740431.579319:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158283776 00000100:00100000:1.0:1790740431.579331:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158283776 00000100:00100000:1.0:1790740431.579381:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790740431.579388:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc12e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5845:x1877727158283776:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:3.0:1790740431.579427:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790740431.579471:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc12e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5845:x1877727158283776:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 83us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740431.579487:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790740431.579514:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc12e5f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1877727158283776:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1790740431.580314:0:5845:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:2.0:1790740431.580369:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1a3ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1877727158283904:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1790740431.580403:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740431.580432:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d81324180 going to sleep for 11 seconds 00000100:00100000:1.0:1790740431.580497:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158283904 00000100:00100000:1.0:1790740431.580502:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158283904 00000100:00100000:1.0:1790740431.580538:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790740431.580545:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5845:x1877727158283904:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1790740431.581032:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5845:x1877727158283904:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 482us (621us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1790740431.581040:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790740431.581124:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1a3ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1877727158283904:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1790740431.581172:0:5845:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:2.0:1790740431.581209:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598ea9fb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.581220:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598ea9fb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.581228:0:5845:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598ea9fb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.581233:0:5845:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87595e00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740431.581238:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598ea9fb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.581245:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598ea9fb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.581260:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f0d944f6500) 00010000:00010000:2.0:1790740431.581263:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1790740431.581267:0:5845:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598ea9fb lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.581272:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598ea9fb lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790740431.581429:0:5845:0:(mdd_object.c:4180:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1790740431.581686:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:2.0:1790740431.581698:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 347532124561ns, next at 348532122609ns, rc = 0 00000001:00080000:2.0:1790740431.581714:0:5845:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:2.0:1790740431.581749:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f0d944f6500) 00010000:00010000:2.0:1790740431.581752:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1790740431.581759:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f800/0xc6b31a1b598ea9e6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee73a expref: 52 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740431.581861:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0da203b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec599375-3198-45fd-a23a-c5620f07177c+51:11573:x1877727133129088:12345-192.168.203.58@tcp:35:lfs.0 Request processed in 10658us (10821us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1790740431.581868:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 56 00000020:00080000:2.0:1790740431.581871:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1790740431.584383:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740431.584465:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133129344 00000100:00100000:2.0:1790740431.584474:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133129344 00000100:00100000:2.0:1790740431.584555:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 202 00000100:00100000:2.0:1790740431.584565:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+51:11573:x1877727133129344:12345-192.168.203.58@tcp:101:lfs.0 00010000:00010000:2.0:1790740431.584621:0:8666:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740431.584644:0:8666:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598eaa02 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee741 expref: -99 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.584706:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598eaa02 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee741 expref: 52 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.584733:0:8666:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598eaa02 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee741 expref: 52 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.584752:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f0d98dcc000) 00010000:00010000:2.0:1790740431.584755:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790740431.584759:0:8666:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d87595400, rc 0) 00000100:00100000:2.0:1790740431.584810:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+52:11573:x1877727133129344:12345-192.168.203.58@tcp:101:lfs.0 Request processed in 247us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740431.584829:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 202 00000100:00100000:3.0:1790740431.592786:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740431.592946:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133129600 00000100:00100000:0.0:1790740431.592955:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133129600 00000100:00100000:0.0:1790740431.593022:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 57 00000100:00100000:0.0:1790740431.593032:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+52:11573:x1877727133129600:12345-192.168.203.58@tcp:35:lfs.0 00000100:00100000:0.0:1790740431.593399:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+53:11573:x1877727133129600:12345-192.168.203.58@tcp:35:lfs.0 Request processed in 368us (620us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1790740431.593407:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 57 00000100:00100000:0.0:1790740431.678697:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740431.678798:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133129728 00000100:00100000:2.0:1790740431.678809:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133129728 00000100:00100000:2.0:1790740431.678911:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 203 00000100:00100000:2.0:1790740431.678921:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc12e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+53:11583:x1877727133129728:12345-192.168.203.58@tcp:34:lfs.0 00010000:00010000:2.0:1790740431.679002:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598eaa09 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.679021:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598eaa09 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.679033:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598eaa09 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.679048:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595600/0xc6b31a1b598eaa10 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.679055:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595600/0xc6b31a1b598eaa10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.679077:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595600/0xc6b31a1b598eaa10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.679158:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598eaa17 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.679166:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598eaa17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.679173:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598eaa17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790740431.679237:0:5842:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598eaa17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.679250:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598eaa09 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.679257:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598eaa09 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.679263:0:5842:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598eaa09 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.679269:0:5842:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87594400 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740431.679272:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598eaa09 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.679279:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598eaa09 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.679289:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f0d98dccd00) 00010000:00010000:2.0:1790740431.679292:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740431.679296:0:5842:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598eaa09 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.679301:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598eaa09 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.679313:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595600/0xc6b31a1b598eaa10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.679319:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595600/0xc6b31a1b598eaa10 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.679332:0:5842:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595600/0xc6b31a1b598eaa10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.679337:0:5842:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87595600 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740431.679340:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595600/0xc6b31a1b598eaa10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.679346:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595600/0xc6b31a1b598eaa10 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.679354:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8f0d98dcc700) 00010000:00010000:2.0:1790740431.679356:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740431.679359:0:5842:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595600/0xc6b31a1b598eaa10 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.679365:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595600/0xc6b31a1b598eaa10 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.679381:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598eaa17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.679386:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598eaa17 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.679391:0:5842:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598eaa17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.679395:0:5842:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87595e00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740431.679398:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598eaa17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.679412:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598eaa17 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.679420:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f0d98dcc000) 00010000:00010000:2.0:1790740431.679422:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740431.679426:0:5842:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598eaa17 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.679432:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598eaa17 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740431.679510:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc12e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+53:11583:x1877727133129728:12345-192.168.203.58@tcp:34:lfs.0 Request processed in 590us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740431.679519:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 203 00000100:00100000:2.0:1790740431.736376:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740431.736474:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133129984 00000100:00100000:3.0:1790740431.736484:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133129984 00000100:00100000:3.0:1790740431.736545:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 204 00000100:00100000:3.0:1790740431.736556:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+53:11586:x1877727133129984:12345-192.168.203.58@tcp:101:lfs.0 00010000:00010000:3.0:1790740431.736610:0:8666:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740431.736633:0:8666:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598eaa1e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee748 expref: -99 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.736704:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598eaa25 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.736719:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598eaa25 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.736729:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598eaa25 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.736758:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598eaa2c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.736765:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598eaa2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.736770:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598eaa2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.736906:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e200/0xc6b31a1b598eaa33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.736915:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e200/0xc6b31a1b598eaa33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.736921:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e200/0xc6b31a1b598eaa33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790740431.736930:0:8666:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1790740431.737021:0:8666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598eaa25 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.737030:0:8666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598eaa25 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.737037:0:8666:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598eaa25 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.737043:0:8666:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0f000 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1790740431.737047:0:8666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598eaa25 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.737077:0:8666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598eaa25 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.737089:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f0d98dccd00) 00010000:00010000:3.0:1790740431.737092:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740431.737098:0:8666:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598eaa25 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.737105:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598eaa25 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.737120:0:8666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598eaa2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.737127:0:8666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598eaa2c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.737133:0:8666:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598eaa2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.737138:0:8666:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0e600 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1790740431.737141:0:8666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598eaa2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.737147:0:8666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598eaa2c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.737155:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8f0d944f6e00) 00010000:00010000:3.0:1790740431.737158:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740431.737160:0:8666:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598eaa2c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.737177:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598eaa2c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.737218:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598eaa1e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee748 expref: 56 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.737232:0:8666:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e200/0xc6b31a1b598eaa33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee748 expref: 55 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.737240:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f0d98dcc000) 00010000:00010000:3.0:1790740431.737242:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790740431.737245:0:8666:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0db6c0e200, rc 0) 00000100:00100000:3.0:1790740431.737424:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+55:11586:x1877727133129984:12345-192.168.203.58@tcp:101:lfs.0 Request processed in 870us (1056us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1790740431.737433:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 204 00000100:00100000:0.0:1790740431.743668:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740431.743798:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133130112 00000100:00100000:3.0:1790740431.743807:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133130112 00000100:00100000:3.0:1790740431.743995:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 205 00000100:00100000:3.0:1790740431.744007:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc12e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+55:11586:x1877727133130112:12345-192.168.203.58@tcp:54:lfs.0 00010000:00010000:3.0:1790740431.744085:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598eaa41 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.744103:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598eaa41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.744114:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598eaa41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.744158:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598eaa41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.744166:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598eaa41 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.744172:0:5843:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598eaa41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.744178:0:5843:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0f600 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1790740431.744183:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598eaa41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.744190:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598eaa41 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.744203:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f0d98dcc000) 00010000:00010000:3.0:1790740431.744207:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790740431.744212:0:5843:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598eaa41 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.744219:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598eaa41 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740431.744385:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc12e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+55:11586:x1877727133130112:12345-192.168.203.58@tcp:54:lfs.0 Request processed in 379us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740431.744394:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 205 00000100:00100000:0.0:1790740431.756464:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740431.756637:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133130368 00000100:00100000:2.0:1790740431.756647:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133130368 00000100:00100000:2.0:1790740431.756706:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 58 00000100:00100000:2.0:1790740431.756718:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d901de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec599375-3198-45fd-a23a-c5620f07177c+55:11586:x1877727133130368:12345-192.168.203.58@tcp:35:lfs.0 00000100:00100000:2.0:1790740431.757176:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d901de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec599375-3198-45fd-a23a-c5620f07177c+56:11586:x1877727133130368:12345-192.168.203.58@tcp:35:lfs.0 Request processed in 460us (721us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1790740431.757183:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 58 00000100:00100000:0.0:1790740431.860877:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740431.861017:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133130624 00000100:00100000:3.0:1790740431.861029:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133130624 00000100:00100000:3.0:1790740431.861099:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 206 00000100:00100000:3.0:1790740431.861122:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d901dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+56:11596:x1877727133130624:12345-192.168.203.58@tcp:101:bash.0 00010000:00010000:3.0:1790740431.861147:0:8666:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740431.861151:0:8666:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1790740431.861177:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598ea9c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee72c expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.861197:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f0d98dccd00) 00010000:00010000:3.0:1790740431.861202:0:8666:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790740431.861215:0:8666:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598eaa48 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee74f expref: -99 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.861308:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598eaa4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.861322:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598eaa4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.861332:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598eaa4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790740431.861343:0:8666:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1790740431.861452:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598eaa48 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee74f expref: 58 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.861466:0:8666:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598eaa4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee74f expref: 57 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.861475:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f0d98dcc000) 00010000:00010000:3.0:1790740431.861477:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790740431.861486:0:8666:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0db6c0e600, rc 0) 00000100:00100000:3.0:1790740431.861770:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d901dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+57:11596:x1877727133130624:12345-192.168.203.58@tcp:101:bash.0 Request processed in 648us (901us total) trans 4294967499 rc 0/0 00000100:00100000:3.0:1790740431.861778:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 206 00000100:00100000:3.0:1790740431.869943:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740431.870097:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133130880 00000100:00100000:2.0:1790740431.870107:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133130880 00000100:00100000:2.0:1790740431.870167:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 207 00000100:00100000:2.0:1790740431.870177:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+57:11596:x1877727133130880:12345-192.168.203.58@tcp:36:bash.0 00010000:00010000:2.0:1790740431.870230:0:5842:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1790740431.870269:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e600/0xc6b31a1b598eaa4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee74f expref: 57 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.870292:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e200/0xc6b31a1b598eaa33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee748 expref: 56 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.870303:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f0d98dcc000) 00010000:00010000:2.0:1790740431.870308:0:5842:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790740431.870493:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598eaa5d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.870506:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598eaa5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.870515:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598eaa5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790740431.870616:0:5842:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967500 00000004:00010000:2.0:1790740431.870645:0:5842:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f9c892a3 reply state 00000000bacc2406 transno 4294967501 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598eaa5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740431.870654:0:5842:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790740431.870747:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+58:11596:x1877727133130880:12345-192.168.203.58@tcp:36:bash.0 Request processed in 570us (813us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1790740431.870755:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 207 00000020:00080000:2.0:1790740431.870760:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1790740431.875173:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00010000:00010000:2.0:1790740431.875248:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598eaa5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.875261:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598eaa5d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.875288:0:3290:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598eaa5d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.875294:0:3290:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87595e00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740431.875299:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598eaa5d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.875307:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598eaa5d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.875323:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f0d98dcc000) 00010000:00010000:2.0:1790740431.875326:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740431.875331:0:3290:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598eaa5d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.875338:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598eaa5d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740431.875442:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133131008 00000100:00100000:3.0:1790740431.875452:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133131008 00000100:00100000:3.0:1790740431.875508:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 208 00000100:00100000:3.0:1790740431.875518:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d901dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+57:11596:x1877727133131008:12345-192.168.203.58@tcp:101:bash.0 00010000:00010000:3.0:1790740431.875541:0:8666:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740431.875567:0:8666:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598eaa64 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee756 expref: -99 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.875679:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598eaa6b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.875693:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598eaa6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.875703:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598eaa6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790740431.875729:0:8666:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1790740431.875733:0:8666:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790740431.875752:0:8666:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598eaa6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.875776:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598eaa64 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee756 expref: 59 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.875806:0:8666:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598eaa6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee756 expref: 58 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.875814:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f0d98dcc000) 00010000:00010000:3.0:1790740431.875817:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790740431.875820:0:8666:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0db6c0ee00, rc 0) 00000100:00100000:3.0:1790740431.875870:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d901dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+58:11596:x1877727133131008:12345-192.168.203.58@tcp:101:bash.0 Request processed in 354us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740431.875878:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 208 00000100:00100000:0.0:1790740431.880325:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740431.880416:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133131264 00000100:00100000:1.0:1790740431.880426:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133131264 00000100:00100000:1.0:1790740431.880483:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 59 00000100:00100000:1.0:1790740431.880494:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d901dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+58:11596:x1877727133131264:12345-192.168.203.58@tcp:35:bash.0 00000100:00100000:1.0:1790740431.880757:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d901dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+59:11596:x1877727133131264:12345-192.168.203.58@tcp:35:bash.0 Request processed in 264us (440us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1790740431.880764:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 59 00000100:00100000:3.0:1790740431.968882:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740431.968973:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133131392 00000100:00100000:2.0:1790740431.968982:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133131392 00000100:00100000:2.0:1790740431.969039:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 209 00000100:00100000:2.0:1790740431.969049:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db5a6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+59:11602:x1877727133131392:12345-192.168.203.58@tcp:101:lfs.0 00010000:00010000:2.0:1790740431.969082:0:5842:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740431.969102:0:5842:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598eaa72 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee75d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.969159:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595600/0xc6b31a1b598eaa79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.969172:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595600/0xc6b31a1b598eaa79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.969195:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595600/0xc6b31a1b598eaa79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740431.969228:0:5842:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1790740431.969232:0:5842:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790740431.969250:0:5842:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595600/0xc6b31a1b598eaa79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.969274:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598eaa72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee75d expref: 61 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.969291:0:5842:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595600/0xc6b31a1b598eaa79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee75d expref: 60 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.969298:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f0d98dccd00) 00010000:00010000:2.0:1790740431.969301:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790740431.969304:0:5842:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d87595600, rc 0) 00000100:00100000:2.0:1790740431.969372:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db5a6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+60:11602:x1877727133131392:12345-192.168.203.58@tcp:101:lfs.0 Request processed in 324us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740431.969380:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 209 00000100:00100000:0.0:1790740431.981702:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740431.983182:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133131520 00000100:00100000:3.0:1790740431.983370:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133131520 00000100:00100000:3.0:1790740431.983541:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 210 00000100:00100000:3.0:1790740431.983552:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d901dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+60:11602:x1877727133131520:12345-192.168.203.58@tcp:101:lfs.0 00010000:00010000:3.0:1790740431.983597:0:8666:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740431.983618:0:8666:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598eaa80 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee764 expref: -99 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.983690:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598eaa87 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.983703:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598eaa87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.983713:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598eaa87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.983745:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f200/0xc6b31a1b598eaa8e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.983753:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f200/0xc6b31a1b598eaa8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.983760:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f200/0xc6b31a1b598eaa8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.983843:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f400/0xc6b31a1b598eaa95 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.983851:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f400/0xc6b31a1b598eaa95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.983871:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f400/0xc6b31a1b598eaa95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790740431.983904:0:8666:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1790740431.983908:0:8666:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790740431.983925:0:8666:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f400/0xc6b31a1b598eaa95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.983936:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f400/0xc6b31a1b598eaa95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.983944:0:8666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598eaa87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.983951:0:8666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598eaa87 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.983967:0:8666:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598eaa87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.983974:0:8666:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0f000 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1790740431.983978:0:8666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598eaa87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.983984:0:8666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598eaa87 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.983997:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f0d98dccd00) 00010000:00010000:3.0:1790740431.984001:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740431.984005:0:8666:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598eaa87 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.984011:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598eaa87 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.984026:0:8666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f200/0xc6b31a1b598eaa8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.984033:0:8666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f200/0xc6b31a1b598eaa8e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.984038:0:8666:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f200/0xc6b31a1b598eaa8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.984043:0:8666:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0f200 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1790740431.984046:0:8666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f200/0xc6b31a1b598eaa8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.984076:0:8666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f200/0xc6b31a1b598eaa8e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.984085:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8f0d944f6e00) 00010000:00010000:3.0:1790740431.984087:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740431.984090:0:8666:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f200/0xc6b31a1b598eaa8e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.984096:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f200/0xc6b31a1b598eaa8e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.984128:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598eaa80 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee764 expref: 62 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.984141:0:8666:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f400/0xc6b31a1b598eaa95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee764 expref: 61 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740431.984148:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f0d98dcc000) 00010000:00010000:3.0:1790740431.984150:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790740431.984153:0:8666:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0db6c0f400, rc 0) 00000100:00100000:3.0:1790740431.984815:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d901dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+61:11602:x1877727133131520:12345-192.168.203.58@tcp:101:lfs.0 Request processed in 1262us (3118us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740431.984825:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 210 00000100:00100000:0.0:1790740431.994986:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740431.995375:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133131776 00000100:00100000:2.0:1790740431.995389:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133131776 00000100:00100000:2.0:1790740431.995521:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 211 00000100:00100000:2.0:1790740431.995533:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d901dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+61:11602:x1877727133131776:12345-192.168.203.58@tcp:101:lfs.0 00010000:00010000:2.0:1790740431.995563:0:5842:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740431.996488:0:5842:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598eaa9c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee76b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.996836:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598eaaa3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.996859:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598eaa6b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee756 expref: 62 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.996869:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f400/0xc6b31a1b598eaa95 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee764 expref: 62 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.996878:0:5842:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598eaaa3 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.996929:0:5842:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f400/0xc6b31a1b598eaa95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee764 expref: 62 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.996949:0:5842:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f400/0xc6b31a1b598eaa95 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee764 expref: 62 pid: 8666 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740431.996968:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda43800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1877727158284032:192.168.203.58@tcp:104: 00010000:00010000:2.0:1790740431.997152:0:5842:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598eaa6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee756 expref: 62 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740431.997162:0:5842:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598eaa6b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee756 expref: 62 pid: 8666 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740431.997172:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d84914000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1877727158284160:192.168.203.58@tcp:104: 00000100:00100000:2.0:1790740431.997210:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d813240c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790740432.009324:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740432.009490:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133131904 00000100:00100000:1.0:1790740432.009502:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133131904 00010000:00010000:1.0:1790740432.009559:0:5829:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f400/0xc6b31a1b598eaa95 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee764 expref: 63 pid: 8666 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740432.009685:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 76 00000100:00100000:1.0:1790740432.009697:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d901dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec599375-3198-45fd-a23a-c5620f07177c+63:2371:x1877727133131904:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790740432.009742:0:5829:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740432.009943:0:5829:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f400/0xc6b31a1b598eaa95 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee764 expref: 63 pid: 8666 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740432.009960:0:5829:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f400/0xc6b31a1b598eaa95 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee764 expref: 63 pid: 8666 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740432.009989:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f0d98dcc000) 00010000:00010000:1.0:1790740432.009996:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598eaaa3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740432.010006:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598eaaa3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740432.010013:0:5829:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790740432.010050:0:5842:0:(ldlm_lockd.c:744:ldlm_handle_ast_error()) ### client (nid 192.168.203.58@tcp) returned -22 from blocking AST (req@000000007602c9e0 x1877727158284032) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f400/0xc6b31a1b598eaa95 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee764 expref: 63 pid: 8666 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.010076:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f400/0xc6b31a1b598eaa95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee764 expref: 63 pid: 8666 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740432.010097:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d901dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec599375-3198-45fd-a23a-c5620f07177c+62:2371:x1877727133131904:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 403us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740432.010098:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda43800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1877727158284032:192.168.203.58@tcp:104: 00000100:00100000:1.0:1790740432.010106:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 76 00000100:00100000:2.0:1790740432.010146:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d84914000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1877727158284160:192.168.203.58@tcp:104: 00010000:00010000:2.0:1790740432.010172:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f0d98dcc000) 00010000:00010000:2.0:1790740432.010176:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598eaaa3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.010184:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598eaaa3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.010193:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598eaaa3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740432.010649:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740432.011258:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133132032 00000100:00100000:1.0:1790740432.011267:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133132032 00010000:00010000:1.0:1790740432.011295:0:5829:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598eaa6b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee756 expref: 62 pid: 8666 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740432.011371:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 77 00000100:00100000:1.0:1790740432.011381:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d901df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec599375-3198-45fd-a23a-c5620f07177c+62:2369:x1877727133132032:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790740432.011393:0:5829:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740432.011399:0:5829:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598eaa6b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee756 expref: 62 pid: 8666 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740432.011435:0:5829:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598eaa6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee756 expref: 62 pid: 8666 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740432.011454:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598eaa6b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee756 expref: 62 pid: 8666 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740432.011469:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f0d98dcc000) 00010000:00010000:1.0:1790740432.011474:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598eaaa3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740432.011483:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598eaaa3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740432.011493:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598eaaa3 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740432.011526:0:5829:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740432.011598:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d901df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec599375-3198-45fd-a23a-c5620f07177c+61:2369:x1877727133132032:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 193us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740432.011606:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 77 00010000:00010000:3.0:1790740432.011662:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598eaaa3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.011672:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598eaaa3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790740432.011706:0:5842:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1790740432.011923:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595e00/0xc6b31a1b598eaa9c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee76b expref: 62 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.011942:0:5842:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598eaaa3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee76b expref: 61 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.011950:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f0d98dcc000) 00010000:00010000:3.0:1790740432.011952:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790740432.011955:0:5842:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d87594400, rc 0) 00000100:00100000:3.0:1790740432.011985:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d901dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+61:11602:x1877727133131776:12345-192.168.203.58@tcp:101:lfs.0 Request processed in 16455us (17017us total) trans 4294967503 rc 0/0 00000100:00100000:3.0:1790740432.011993:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 211 00000100:00100000:0.0:1790740432.015198:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740432.015296:0:8506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133132288 00000100:00100000:3.0:1790740432.015311:0:8506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133132288 00000100:00100000:3.0:1790740432.015397:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 16 00000100:00100000:3.0:1790740432.015409:0:8506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d901dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec599375-3198-45fd-a23a-c5620f07177c+61:11602:x1877727133132288:12345-192.168.203.58@tcp:103:lfs.0 00010000:00010000:3.0:1790740432.015432:0:8506:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740432.015463:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595400/0xc6b31a1b598eaa02 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee741 expref: 61 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.015487:0:8506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f0d98dcc000) 00010000:00010000:3.0:1790740432.015492:0:8506:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790740432.015563:0:8506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d901dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec599375-3198-45fd-a23a-c5620f07177c+60:11602:x1877727133132288:12345-192.168.203.58@tcp:103:lfs.0 Request processed in 157us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740432.015795:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 16 00000100:00100000:0.0:1790740432.021201:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740432.021420:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133132416 00000100:00100000:1.0:1790740432.021434:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133132416 00000100:00100000:1.0:1790740432.021537:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 212 00000100:00100000:1.0:1790740432.021550:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d901ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+60:11602:x1877727133132416:12345-192.168.203.58@tcp:58:lfs.0 00010000:00010000:1.0:1790740432.021715:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598eaab1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740432.021739:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598eaab1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740432.021774:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598eaab1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790740432.022026:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1790740432.022157:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d901ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+60:11602:x1877727133132416:12345-192.168.203.58@tcp:58:lfs.0 Request processed in 609us (969us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740432.022167:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 212 00000100:00100000:0.0:1790740432.024464:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740432.026727:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133132544 00000100:00100000:3.0:1790740432.026750:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133132544 00000100:00100000:2.0:1790740432.027137:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 213 00000100:00100000:2.0:1790740432.027151:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d901dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+60:11602:x1877727133132544:12345-192.168.203.58@tcp:101:lfs.0 00010000:00010000:2.0:1790740432.027181:0:5843:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740432.027210:0:5843:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598eaab8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee772 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.027290:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598eaab1 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.027327:0:5843:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598eaab8 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee772 expref: 61 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.027352:0:5843:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598eaab1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.027370:0:5843:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598eaab8 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee772 expref: 61 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.027389:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f0d98dcc000) 00010000:00010000:2.0:1790740432.027393:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790740432.027397:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598eaab8 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee772 expref: 61 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.027406:0:5843:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d87594a00, rc 0) 00000100:00100000:2.0:1790740432.027501:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d901dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+61:11602:x1877727133132544:12345-192.168.203.58@tcp:101:lfs.0 Request processed in 353us (3051us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740432.027509:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 213 00010000:00010000:0.0:1790740432.176784:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740432.178139:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790740432.178166:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d84914e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877727158284416:0@lo:400:kworker.0 00000100:00100000:1.0:1790740432.178166:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158284672:0@lo:400:kworker.0 00000100:00100000:0.0:1790740432.178282:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d98511f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1877727158284800:0@lo:400:kworker.0 00000100:00100000:3.0:1790740432.178342:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740432.178360:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d84917100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1877727158284544:0@lo:400:kworker.0 00000100:00100000:0.0:1790740432.178415:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740432.178444:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d98512d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158284928:0@lo:400:kworker.0 00000100:00100000:0.0:1790740432.178480:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158284416 00000100:00100000:0.0:1790740432.178491:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158284416 00000100:00100000:3.0:1790740432.178492:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740432.178538:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158284928 00000100:00100000:3.0:1790740432.178544:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158284928 00000100:00100000:0.0:1790740432.178559:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158284544 00000100:00100000:0.0:1790740432.178564:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158284544 00000100:00100000:3.0:1790740432.178634:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1790740432.178645:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d86548380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1877727158284928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740432.178718:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d86548380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1877727158284928:12345-0@lo:400:kworker.0 Request processed in 75us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740432.178772:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1790740432.178783:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db5a69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877727158284416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740432.178821:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740432.178825:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db5a69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877727158284416:12345-0@lo:400:kworker.0 Request processed in 46us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740432.178832:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1790740432.178846:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d84914000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3305:1877727158284288:0@lo:400:kworker.0 00000100:00100000:2.0:1790740432.178852:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1790740432.178858:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d901ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877727158284544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740432.178876:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740432.178890:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d901ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877727158284544:12345-0@lo:400:kworker.0 Request processed in 32us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740432.178904:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1790740432.178909:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158284288 00000100:00100000:1.0:1790740432.178912:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158284288 00000100:00100000:2.0:1790740432.178938:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740432.178940:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1790740432.178946:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3305:x1877727158284288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740432.178966:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158284800 00000100:00100000:2.0:1790740432.178970:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158284800 00000100:00100000:1.0:1790740432.178980:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3305:x1877727158284288:12345-0@lo:400:kworker.0 Request processed in 35us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740432.178986:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1790740432.178993:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1790740432.178999:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d98510380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877727158284800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740432.179017:0:8460:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158284672 00000100:00100000:1.0:1790740432.179020:0:8460:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158284672 00000100:00100000:2.0:1790740432.179031:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d98510380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877727158284800:12345-0@lo:400:kworker.0 Request processed in 33us (93us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740432.179037:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1790740432.179099:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d98511f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1877727158284800:0@lo:400:kworker.0 00000100:00080000:2.0:1790740432.179149:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790740432.179155:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790740432.179178:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d98512d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158284928:0@lo:400:kworker.0 00000100:00100000:2.0:1790740432.179189:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d84914e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877727158284416:0@lo:400:kworker.0 00000100:00100000:2.0:1790740432.179410:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d84917100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1877727158284544:0@lo:400:kworker.0 00000100:00100000:2.0:1790740432.184901:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d84914000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3305:1877727158284288:0@lo:400:kworker.0 00000100:00100000:3.0:1790740432.185895:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1790740432.188205:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1790740432.188245:0:8460:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3305:x1877727158284672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740432.188390:0:8460:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3305:x1877727158284672:12345-0@lo:400:kworker.0 Request processed in 163us (9568us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740432.188399:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1790740432.188834:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158284672:0@lo:400:kworker.0 00000040:00080000:2.0:1790740432.369040:0:11679:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790740432.369052:0:11679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790740432.369734:0:11679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1790740432.369745:0:11679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790740432.370140:0:11679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d98512d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11679:1877727158285056:192.168.203.58@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790740432.370947:0:11679:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d813240c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790740432.378205:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740432.378464:0:11679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d98512d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11679:1877727158285056:192.168.203.58@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790740432.379102:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133132672 00000100:00100000:3.0:1790740432.379113:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133132672 00000100:00100000:3.0:1790740432.379223:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 214 00000100:00100000:3.0:1790740432.379236:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d901dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+61:11604:x1877727133132672:12345-192.168.203.58@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790740432.379281:0:5842:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790740432.379418:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d901dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+61:11604:x1877727133132672:12345-192.168.203.58@tcp:53:lhsmtool_posix.0 Request processed in 184us (1228us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740432.379427:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 214 00000100:00100000:0.0:1790740432.384375:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740432.384601:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133132800 00000100:00100000:2.0:1790740432.384614:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133132800 00000100:00100000:2.0:1790740432.384765:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 215 00000100:00100000:2.0:1790740432.384781:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d901df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+61:11604:x1877727133132800:12345-192.168.203.58@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1790740432.384881:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598eaabf lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.384903:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598eaabf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.384917:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598eaabf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.384946:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598eaac6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.384954:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598eaac6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.384962:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598eaac6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.384988:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598eaacd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.384997:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598eaacd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.385003:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598eaacd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740432.385087:0:8666:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1790740432.385094:0:8666:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790740432.385111:0:8666:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598eaacd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.385125:0:8666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598eaabf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.385132:0:8666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598eaabf lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.385140:0:8666:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598eaabf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.385146:0:8666:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87595800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740432.385151:0:8666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598eaabf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.385158:0:8666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598eaabf lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.385172:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f0d944f6600) 00010000:00010000:2.0:1790740432.385175:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740432.385181:0:8666:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598eaabf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.385187:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598eaabf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.385202:0:8666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598eaac6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.385219:0:8666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598eaac6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.385226:0:8666:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598eaac6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.385232:0:8666:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87595c00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740432.385235:0:8666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598eaac6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.385243:0:8666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598eaac6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.385251:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff8f0d98dcc700) 00010000:00010000:2.0:1790740432.385254:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740432.385257:0:8666:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598eaac6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.385263:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595c00/0xc6b31a1b598eaac6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.385279:0:8666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598eaacd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.385286:0:8666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598eaacd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.385291:0:8666:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598eaacd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.385297:0:8666:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87594200 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740432.385317:0:8666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598eaacd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.385325:0:8666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598eaacd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.385334:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f0d98dcc000) 00010000:00010000:2.0:1790740432.385337:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740432.385340:0:8666:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598eaacd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.385347:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594200/0xc6b31a1b598eaacd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740432.385440:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d901df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+61:11604:x1877727133132800:12345-192.168.203.58@tcp:34:lhsmtool_posix.0 Request processed in 663us (1141us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740432.385449:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 215 00000100:00100000:3.0:1790740432.389914:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740432.390036:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133133056 00000100:00100000:2.0:1790740432.390053:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133133056 00000100:00100000:2.0:1790740432.390150:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 216 00000100:00100000:2.0:1790740432.390162:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd7d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+61:11604:x1877727133133056:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790740432.390190:0:5843:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740432.390217:0:5843:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598eaad4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee779 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.390348:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598eaadb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.390367:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598eaadb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.390403:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598eaadb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740432.390418:0:5843:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1790740432.391197:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598eaadb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.391213:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598eaadb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.391221:0:5843:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598eaadb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.391227:0:5843:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87594000 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740432.391234:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598eaadb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.391243:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598eaadb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.391259:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f0d98dcc000) 00010000:00010000:2.0:1790740432.391263:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790740432.391270:0:5843:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598eaadb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.391277:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598eaadb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.391336:0:5843:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598eaad4 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee779 expref: 63 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.391368:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f0d944f6600) 00010000:00010000:2.0:1790740432.391371:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790740432.391376:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598eaad4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee779 expref: 63 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.391388:0:5843:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d87594e00, rc 0) 00000100:00100000:2.0:1790740432.391908:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd7d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+62:11604:x1877727133133056:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 Request processed in 1314us (1570us total) trans 4294967504 rc 301/301 00000100:00100000:2.0:1790740432.391919:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 216 00000100:00100000:0.0:1790740432.400491:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740432.400934:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133133184 00000100:00100000:1.0:1790740432.400944:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133133184 00000100:00100000:1.0:1790740432.401001:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 217 00000100:00100000:1.0:1790740432.401011:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d901ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+62:11604:x1877727133133184:12345-192.168.203.58@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790740432.401050:0:5844:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790740432.401187:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d901ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+62:11604:x1877727133133184:12345-192.168.203.58@tcp:53:lhsmtool_posix.0 Request processed in 177us (982us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740432.401195:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 217 00000100:00100000:0.0:1790740432.412411:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740432.412548:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133133440 00000100:00100000:3.0:1790740432.412557:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133133440 00000100:00100000:3.0:1790740432.412657:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 218 00000100:00100000:3.0:1790740432.412668:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d901de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+62:11604:x1877727133133440:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790740432.412703:0:5842:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740432.412706:0:5842:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1790740432.412733:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595600/0xc6b31a1b598eaa79 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee75d expref: 62 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.412752:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f0d98dccd00) 00010000:00010000:3.0:1790740432.412757:0:5842:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790740432.412770:0:5842:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598eaae9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee780 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790740432.413193:0:5842:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:3.0:1790740432.413374:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f200/0xc6b31a1b598eaaf0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.413400:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f200/0xc6b31a1b598eaaf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.413410:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f200/0xc6b31a1b598eaaf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.413464:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598eaae9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee780 expref: 64 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.413481:0:5842:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f200/0xc6b31a1b598eaaf0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee780 expref: 63 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.413489:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8f0d944f6e00) 00010000:00010000:3.0:1790740432.413491:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790740432.413500:0:5842:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0db6c0f200, rc 0) 00000100:00100000:3.0:1790740432.413557:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d901de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+63:11604:x1877727133133440:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 Request processed in 889us (1154us total) trans 4294967505 rc 0/0 00000100:00100000:3.0:1790740432.413565:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 218 00000100:00100000:3.0:1790740432.419308:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740432.419548:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133133696 00000100:00100000:1.0:1790740432.419559:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133133696 00000100:00100000:2.0:1790740432.419743:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 219 00000100:00100000:2.0:1790740432.419756:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd7d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+63:11604:x1877727133133696:12345-192.168.203.58@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790740432.419836:0:8666:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740432.419863:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f200/0xc6b31a1b598eaaf0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee780 expref: 63 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.419885:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8f0d944f6e00) 00010000:00010000:2.0:1790740432.419896:0:8666:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790740432.419917:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598eaafe lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.419940:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598eaafe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.419949:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598eaafe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.419980:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598eab05 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x534903d3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.419988:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598eab05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x534903d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.419995:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598eab05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x534903d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.420071:0:8666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598eaafe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.420079:0:8666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598eaafe lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.420085:0:8666:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598eaafe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.420091:0:8666:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87594e00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740432.420095:0:8666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598eaafe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.420103:0:8666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598eaafe lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.420111:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f0d98dccd00) 00010000:00010000:2.0:1790740432.420114:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740432.420118:0:8666:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598eaafe lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.420123:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598eaafe lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.420150:0:8666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598eab05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x534903d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.420156:0:8666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598eab05 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x534903d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.420161:0:8666:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598eab05 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x534903d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.420166:0:8666:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87594000 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740432.420169:0:8666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598eab05 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x534903d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.420175:0:8666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598eab05 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x534903d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.420184:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x534903d3 (ffff8f0d98dcc700) 00010000:00010000:2.0:1790740432.420187:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740432.420190:0:8666:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598eab05 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x534903d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.420195:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598eab05 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x534903d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740432.420284:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd7d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+62:11604:x1877727133133696:12345-192.168.203.58@tcp:36:lhsmtool_posix.0 Request processed in 531us (984us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790740432.420292:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 219 00000100:00100000:0.0:1790740432.423981:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740432.424243:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133133824 00000100:00100000:3.0:1790740432.424253:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133133824 00000100:00100000:3.0:1790740432.424307:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 220 00000100:00100000:3.0:1790740432.424318:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d901df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+62:11604:x1877727133133824:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790740432.424338:0:5842:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740432.424360:0:5842:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598eab0c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee787 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.424395:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598eab13 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.424409:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598eab13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.424420:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598eab13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.424528:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598eab0c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee787 expref: 64 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.424548:0:5842:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598eab13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee787 expref: 63 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.424556:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8f0d944f6500) 00010000:00010000:3.0:1790740432.424566:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790740432.424617:0:5842:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0db6c0f000, rc 0) 00000100:00100000:3.0:1790740432.424879:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d901df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+63:11604:x1877727133133824:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 Request processed in 562us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740432.424887:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 220 00000100:00100000:0.0:1790740432.429431:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740432.430233:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133134080 00000100:00100000:2.0:1790740432.430243:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133134080 00000100:00100000:2.0:1790740432.430305:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 221 00000100:00100000:2.0:1790740432.430327:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d901dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+63:11604:x1877727133134080:12345-192.168.203.58@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790740432.430403:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598eab1a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.430419:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598eab1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.430430:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598eab1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790740432.431147:0:8666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:2.0:1790740432.431159:0:8666:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 348381585643ns, next at 349381583069ns, rc = 0 00000004:00010000:2.0:1790740432.431240:0:8666:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000000e498ade reply state 000000007f753ff9 transno 4294967506 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598eab1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740432.431251:0:8666:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790740432.431451:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d901dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+65:11604:x1877727133134080:12345-192.168.203.58@tcp:36:lhsmtool_posix.0 Request processed in 1123us (2027us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1790740432.431460:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 221 00000100:00100000:0.0:1790740432.435960:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740432.436498:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133134208 00000100:00100000:3.0:1790740432.436507:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133134208 00000100:00100000:3.0:1790740432.436565:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 222 00000100:00100000:3.0:1790740432.436613:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1b42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+65:11604:x1877727133134208:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790740432.436634:0:5842:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740432.436790:0:5842:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598eab21 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee78e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.436860:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598eab21 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee78e expref: 66 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.436875:0:5842:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598eab21 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee78e expref: 66 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.436893:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8f0d944f6500) 00010000:00010000:3.0:1790740432.436897:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790740432.436900:0:5842:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0db6c0f600, rc 0) 00000100:00100000:3.0:1790740432.437117:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1b42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+66:11604:x1877727133134208:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 Request processed in 542us (1165us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740432.437125:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 222 00000100:00100000:3.0:1790740432.440255:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740432.440355:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133134336 00000100:00100000:1.0:1790740432.440367:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133134336 00000100:00100000:1.0:1790740432.440437:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 62 00000100:00100000:1.0:1790740432.440446:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd7d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec599375-3198-45fd-a23a-c5620f07177c+9:2370:x1877727133134336:12345-192.168.203.58@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1790740432.441321:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd7d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec599375-3198-45fd-a23a-c5620f07177c+10:2370:x1877727133134336:12345-192.168.203.58@tcp:2:lhsmtool_posix.0 Request processed in 871us (1068us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1790740432.441331:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 62 00000100:00080000:3.0:1790740432.441814:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1790740432.443859:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598eab1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.443877:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598eab1a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.443886:0:3289:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598eab1a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.443893:0:3289:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87594000 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740432.443897:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598eab1a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.444146:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598eab1a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.444165:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8f0d944f6500) 00010000:00010000:2.0:1790740432.444168:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790740432.444174:0:3289:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598eab1a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.444180:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598eab1a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740432.450290:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740432.450378:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133134592 00000100:00100000:0.0:1790740432.450389:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133134592 00000100:00100000:0.0:1790740432.450442:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 60 00000100:00100000:0.0:1790740432.450451:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+65:11604:x1877727133134592:12345-192.168.203.58@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1790740432.450739:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+66:11604:x1877727133134592:12345-192.168.203.58@tcp:35:lhsmtool_posix.0 Request processed in 288us (456us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1790740432.450746:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 60 00000100:00100000:0.0:1790740432.456768:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740432.457207:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133134848 00000100:00100000:1.0:1790740432.457218:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133134848 00000100:00100000:1.0:1790740432.457274:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 223 00000100:00100000:1.0:1790740432.457284:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1b43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+66:11604:x1877727133134848:12345-192.168.203.58@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1790740432.457389:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1b43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+66:11604:x1877727133134848:12345-192.168.203.58@tcp:57:lhsmtool_posix.0 Request processed in 106us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740432.457397:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 223 00000100:00100000:3.0:1790740432.462076:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740432.462628:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133134976 00000100:00100000:2.0:1790740432.462647:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133134976 00000100:00100000:2.0:1790740432.462700:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 224 00000100:00100000:2.0:1790740432.462709:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd7d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+66:11604:x1877727133134976:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790740432.462729:0:5842:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740432.462750:0:5842:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598eab28 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee795 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.462817:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598eab2f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.462832:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598eab2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.462843:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598eab2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740432.462875:0:5842:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790740432.463402:0:5842:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598eab2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.463432:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594000/0xc6b31a1b598eab28 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee795 expref: 68 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.463451:0:5842:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598eab2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee795 expref: 67 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.463460:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8f0d944f6500) 00010000:00010000:2.0:1790740432.463463:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1790740432.463467:0:5842:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d87594e00, rc 0) 00000100:00100000:2.0:1790740432.463540:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd7d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+67:11604:x1877727133134976:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 Request processed in 832us (1481us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740432.463548:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 224 00000100:00100000:0.0:1790740432.469876:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740432.470406:0:8460:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133135104 00000100:00100000:1.0:1790740432.470429:0:8460:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133135104 00000100:00100000:1.0:1790740432.470517:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 63 00000100:00100000:1.0:1790740432.470527:0:8460:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1e56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec599375-3198-45fd-a23a-c5620f07177c+10:2369:x1877727133135104:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790740432.470544:0:8460:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740432.470563:0:8460:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003393d045/0xc6b31a1b598eab36 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee79c expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790740432.470623:0:8460:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abc87d0, blocks: 0x1 00010000:00010000:1.0:1790740432.470653:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=348s v=(0 0) 00010000:00010000:1.0:1790740432.470658:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790740432.470667:0:8460:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003393d045/0xc6b31a1b598eab36 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee79c expref: 11 pid: 8460 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740432.470684:0:8460:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003393d045/0xc6b31a1b598eab36 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee79c expref: 11 pid: 8460 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740432.470697:0:8460:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9f977000, rc 0) 00000100:00100000:1.0:1790740432.470747:0:8460:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1e56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec599375-3198-45fd-a23a-c5620f07177c+11:2369:x1877727133135104:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 Request processed in 222us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740432.470754:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 63 00000100:00100000:1.0:1790740432.482407:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740432.483305:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133135360 00000100:00100000:2.0:1790740432.483440:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133135360 00000100:00100000:2.0:1790740432.483504:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 225 00000100:00100000:2.0:1790740432.483514:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+67:11604:x1877727133135360:12345-192.168.203.58@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790740432.484844:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+67:11604:x1877727133135360:12345-192.168.203.58@tcp:57:lhsmtool_posix.0 Request processed in 1324us (2438us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740432.484856:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 225 00000100:00100000:3.0:1790740432.491941:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740432.493119:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133135488 00000100:00100000:1.0:1790740432.493131:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133135488 00000100:00100000:1.0:1790740432.493196:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 64 00000100:00100000:1.0:1790740432.493206:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd7d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec599375-3198-45fd-a23a-c5620f07177c+11:11604:x1877727133135488:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790740432.493224:0:6699:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740432.493262:0:6699:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006fd3a7db/0xc6b31a1b598eab3d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee7a3 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740432.494145:0:6699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003393d045/0xc6b31a1b598eab36 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee79c expref: 12 pid: 8460 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740432.494159:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790740432.494163:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790740432.494169:0:6699:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006fd3a7db/0xc6b31a1b598eab3d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee7a3 expref: 12 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740432.494204:0:6699:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003393d045/0xc6b31a1b598eab36 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee79c expref: 12 pid: 8460 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740432.494220:0:6699:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003393d045/0xc6b31a1b598eab36 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee79c expref: 12 pid: 8460 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740432.494246:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda75180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6699:1877727158285184:192.168.203.58@tcp:104: 00000100:00100000:1.0:1790740432.496047:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0c84c11d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790740432.504648:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740432.504750:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda75180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6699:1877727158285184:192.168.203.58@tcp:104: 00010000:00010000:1.0:1790740432.504783:0:6699:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006fd3a7db/0xc6b31a1b598eab3d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee7a3 expref: 12 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740432.504803:0:6699:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9f976000, rc 0) 00000100:00100000:1.0:1790740432.504922:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd7d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec599375-3198-45fd-a23a-c5620f07177c+12:11604:x1877727133135488:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 Request processed in 11716us (12987us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740432.504944:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 64 00000100:00100000:2.0:1790740432.505247:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133135616 00000100:00100000:2.0:1790740432.505255:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133135616 00010000:00010000:2.0:1790740432.505285:0:5830:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003393d045/0xc6b31a1b598eab36 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee79c expref: 12 pid: 8460 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740432.505320:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 78 00000100:00100000:2.0:1790740432.505329:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1b43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec599375-3198-45fd-a23a-c5620f07177c+12:2369:x1877727133135616:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790740432.505343:0:5830:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740432.505371:0:5830:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003393d045/0xc6b31a1b598eab36 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee79c expref: 12 pid: 8460 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.505394:0:5830:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003393d045/0xc6b31a1b598eab36 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee79c expref: 12 pid: 8460 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.505416:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003393d045/0xc6b31a1b598eab36 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee79c expref: 12 pid: 8460 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.505433:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790740432.505437:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790740432.505444:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006fd3a7db/0xc6b31a1b598eab3d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee7a3 expref: 11 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.505454:0:5830:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006fd3a7db/0xc6b31a1b598eab3d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee7a3 expref: 11 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.505492:0:5830:0:(ldlm_lockd.c:1085:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006fd3a7db/0xc6b31a1b598eab3d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee7a3 expref: 11 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740432.505506:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d98512d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5830:1877727158285312:192.168.203.58@tcp:105: 00000100:00100000:2.0:1790740432.505606:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d81324300 going to sleep for 11 seconds 00000100:00100000:0.0:1790740432.516995:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740432.517079:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133135744 00000100:00100000:3.0:1790740432.517089:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133135744 00002000:00100000:3.0:1790740432.517148:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff8f0dc1b42300 x1877727133135744/t0(0) o4->ec599375-3198-45fd-a23a-c5620f07177c@192.168.203.58@tcp:488/0 lens 504/0 e 0 to 0 dl 1790740443 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790740432.517159:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f0dc1b42300 with x1877727133135744 ext(0->12) 00002000:00010000:3.0:1790740432.517164:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f0dc1b42300 00000100:00100000:3.0:1790740432.517197:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 6 00000100:00100000:3.0:1790740432.517206:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1b42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ec599375-3198-45fd-a23a-c5620f07177c+12:2370:x1877727133135744:12345-192.168.203.58@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1790740432.517544:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d98512d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5830:1877727158285312:192.168.203.58@tcp:105: 00010000:00010000:2.0:1790740432.517565:0:5830:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790740432.517788:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1b43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec599375-3198-45fd-a23a-c5620f07177c+12:2369:x1877727133135616:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 12458us (13147us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740432.517809:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 78 00000100:00100000:3.0:1790740432.518412:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1b42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ec599375-3198-45fd-a23a-c5620f07177c+13:2370:x1877727133135744:12345-192.168.203.58@tcp:4:lhsmtool_posix.0 Request processed in 1205us (1425us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1790740432.518422:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 6 00002000:00100000:3.0:1790740432.518432:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff8f0dc1b42300 x1877727133135744/t4294967320(0) o4->ec599375-3198-45fd-a23a-c5620f07177c@192.168.203.58@tcp:488/0 lens 504/448 e 0 to 0 dl 1790740443 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790740432.518441:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f0dc1b42300 with x1877727133135744 ext(0->12) 00002000:00010000:3.0:1790740432.518447:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f0dc1b42300 00000100:00100000:0.0:1790740432.522773:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740432.522869:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133135872 00000100:00100000:2.0:1790740432.522879:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133135872 00000100:00100000:2.0:1790740432.522975:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 226 00000100:00100000:2.0:1790740432.522987:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1b40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+67:11604:x1877727133135872:12345-192.168.203.58@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1790740432.569320:0:5865:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000004:00080000:1.0:1790740432.569346:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000004:00080000:1.0:1790740432.569388:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000004:00080000:1.0:1790740432.569414:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:1.0:1790740432.569436:0:5865:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f0d813243c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1790740432.569441:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f0dc117a100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f0d81324000 00000020:00080000:1.0:1790740432.569444:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f0d91880400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f0dbee4e000 00000020:00080000:1.0:1790740432.569464:0:5865:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f0d81324b40 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1790740432.569467:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f0d91c88700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f0d81324480 00000020:00080000:1.0:1790740432.569470:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f0d91c88e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f0db5793000 00000020:00080000:1.0:1790740432.569915:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1790740432.570093:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1790740432.570104:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790740432.570125:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158285440:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1790740432.570349:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740432.570455:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158285568:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1790740432.570479:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740432.570668:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1b40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+20:11604:x1877727133135872:12345-192.168.203.58@tcp:44:lhsmtool_posix.0 Request processed in 47679us (47902us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740432.570680:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 226 00000100:00100000:0.0:1790740432.572330:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158285440 00000100:00100000:0.0:1790740432.572342:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158285440 00000100:00100000:0.0:1790740432.572388:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158285568 00000100:00100000:0.0:1790740432.572391:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158285568 00000100:00100000:0.0:1790740432.572425:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1790740432.572433:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3303:x1877727158285440:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1790740432.572462:0:6701:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:0.0:1790740432.572483:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9660066/0xc6b31a1b598eab44 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740432.572505:0:6701:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000be67bec2/0xc6b31a1b598ea906 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee702 expref: 12 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740432.572515:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1790740432.572519:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790740432.572524:0:6701:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9660066/0xc6b31a1b598eab44 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740432.572556:0:6701:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000be67bec2/0xc6b31a1b598ea906 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee702 expref: 12 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740432.572587:0:6701:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000be67bec2/0xc6b31a1b598ea906 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee702 expref: 12 pid: 6699 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740432.572602:0:6701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1b40e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6701:1877727158285824:192.168.203.58@tcp:104: 00000100:00100000:2.0:1790740432.572614:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1790740432.572625:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3305:x1877727158285568:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1790740432.572673:0:6701:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0dbec32a80 going to sleep for 11 seconds 00002000:00010000:2.0:1790740432.572777:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1790740432.572781:0:6700:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1790740432 00002000:00010000:2.0:1790740432.572783:0:6700:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1790740432.572785:0:6700:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1790740432 -> 1790740432 00002000:00010000:2.0:1790740432.572787:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1790740432.572832:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3305:x1877727158285568:12345-0@lo:2:osp-syn-1-0.0 Request processed in 206us (2346us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1790740432.572839:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:1.0:1790740432.572842:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f0dbda77b80/2, rc 0, transno 4294967321 00000100:00100000:1.0:1790740432.572848:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158285568:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1790740432.572858:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790740432.572866:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158285696:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1790740432.572895:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740432.572930:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158285696 00000100:00100000:1.0:1790740432.572940:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158285696 00000100:00100000:1.0:1790740432.572961:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1790740432.572965:0:6700:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1790740432.572967:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3305:x1877727158285696:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1790740432.572972:0:6700:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00002000:00080000:1.0:1790740432.572978:0:6699:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:1.0:1790740432.572999:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6abc87cf, atime: 0x6abc87cf, ctime: 0x6abc87cf, blocks: 0x1 00010000:00010000:1.0:1790740432.573007:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003393d045/0xc6b31a1b598eab4b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740432.573016:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=348s v=(0 0) 00010000:00010000:1.0:1790740432.573019:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790740432.573036:0:6699:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003393d045/0xc6b31a1b598eab4b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740432.573067:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003393d045/0xc6b31a1b598eab4b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740432.573078:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003393d045/0xc6b31a1b598eab4b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740432.573085:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003393d045/0xc6b31a1b598eab4b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740432.574072:0:6699:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790740432.574277:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790740432.574284:0:5831:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003393d045/0xc6b31a1b598eab4b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.574294:0:5831:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f977000 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:2.0:1790740432.574300:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003393d045/0xc6b31a1b598eab4b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.574309:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003393d045/0xc6b31a1b598eab4b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.574333:0:5831:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003393d045/0xc6b31a1b598eab4b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.574340:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003393d045/0xc6b31a1b598eab4b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.574365:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740432.574367:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740432.574368:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740432.574648:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3305:x1877727158285696:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1678us (1750us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1790740432.574657:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:2.0:1790740432.574665:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f0dbda76a00/2, rc 0, transno 4294967310 00000100:00100000:2.0:1790740432.574671:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158285696:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1790740432.576602:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740432.576650:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740432.576837:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133136128 00000100:00100000:3.0:1790740432.576847:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133136128 00000100:00100000:2.0:1790740432.576873:0:6701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1b40e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6701:1877727158285824:192.168.203.58@tcp:104: 00010000:00010000:3.0:1790740432.576889:0:5828:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000be67bec2/0xc6b31a1b598ea906 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee702 expref: 13 pid: 6699 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.576896:0:6701:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e9660066/0xc6b31a1b598eab44 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740432.576933:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 79 00000100:00100000:3.0:1790740432.576942:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1b40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec599375-3198-45fd-a23a-c5620f07177c+13:2369:x1877727133136128:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790740432.576955:0:5828:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790740432.576956:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133136000 00010000:00010000:3.0:1790740432.576961:0:5828:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000be67bec2/0xc6b31a1b598ea906 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee702 expref: 13 pid: 6699 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740432.576964:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133136000 00010000:00010000:3.0:1790740432.576973:0:5828:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000be67bec2/0xc6b31a1b598ea906 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee702 expref: 14 pid: 6699 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740432.576995:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 68 00010000:00010000:3.0:1790740432.576996:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be67bec2/0xc6b31a1b598ea906 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee702 expref: 14 pid: 6699 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740432.577002:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1b41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec599375-3198-45fd-a23a-c5620f07177c+14:2369:x1877727133136000:12345-192.168.203.58@tcp:16:lhsmtool_posix.0 00010000:00010000:3.0:1790740432.577012:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790740432.577015:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790740432.577020:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e9660066/0xc6b31a1b598eab44 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.577029:0:5828:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9660066/0xc6b31a1b598eab44 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.577049:0:5828:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790740432.577103:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1b40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec599375-3198-45fd-a23a-c5620f07177c+13:2369:x1877727133136128:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 162us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740432.577118:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 79 00010000:00010000:2.0:1790740432.577394:0:6701:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e9660066/0xc6b31a1b598eab44 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.577403:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9660066/0xc6b31a1b598eab44 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.577413:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9660066/0xc6b31a1b598eab44 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.577420:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9660066/0xc6b31a1b598eab44 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.577451:0:6701:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790740432.577517:0:11661:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740432.577525:0:11661:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9660066/0xc6b31a1b598eab44 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.577532:0:11661:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132fe00 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:3.0:1790740432.577537:0:11661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9660066/0xc6b31a1b598eab44 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.577546:0:11661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9660066/0xc6b31a1b598eab44 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.577557:0:11661:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9660066/0xc6b31a1b598eab44 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.577563:0:11661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9660066/0xc6b31a1b598eab44 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.577604:0:11661:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740432.577606:0:11661:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740432.577607:0:11661:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740432.578001:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3303:x1877727158285440:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5567us (7651us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1790740432.578010:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000004:00080000:3.0:1790740432.578360:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f0dbda75180/2, rc 0, transno 4294967322 00000100:00100000:3.0:1790740432.578366:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158285440:0@lo:6:osp-syn-1-0.0 00000001:00080000:2.0:1790740432.610759:0:7642:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967319 is committed 00000001:00080000:2.0:1790740432.610776:0:7642:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000001:00080000:2.0:1790740432.610784:0:7642:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:2.0:1790740432.610793:0:7642:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000100:00100000:0.0:1790740432.610993:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1b41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec599375-3198-45fd-a23a-c5620f07177c+7:2369:x1877727133136000:12345-192.168.203.58@tcp:16:lhsmtool_posix.0 Request processed in 33986us (34418us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740432.611023:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 68 00000100:00100000:0.0:1790740432.614453:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740432.614507:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133136384 00000100:00100000:2.0:1790740432.614517:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133136384 00000100:00100000:2.0:1790740432.614603:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 227 00000100:00100000:2.0:1790740432.614614:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1b41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+20:11604:x1877727133136384:12345-192.168.203.58@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790740432.614833:0:8666:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740432.614861:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598eab2f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee795 expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.614880:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8f0d944f6500) 00010000:00010000:2.0:1790740432.614885:0:8666:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790740432.614915:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598eab52 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.614930:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598eab52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.614939:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598eab52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790740432.615335:0:8666:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000010459538 reply state 0000000096907c4b transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598eab52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740432.615345:0:8666:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790740432.615497:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1b41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+21:11604:x1877727133136384:12345-192.168.203.58@tcp:36:lhsmtool_posix.0 Request processed in 884us (1049us total) trans 4294967508 rc 0/0 00000100:00100000:2.0:1790740432.615504:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 227 00000100:00100000:2.0:1790740432.619814:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740432.619970:0:12467:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133136512 00000100:00100000:0.0:1790740432.619980:0:12467:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133136512 00000100:00100000:0.0:1790740432.620041:0:12467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 69 00000100:00100000:0.0:1790740432.620051:0:12467:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d98512d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ec599375-3198-45fd-a23a-c5620f07177c+7:2370:x1877727133136512:12345-192.168.203.58@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1790740432.620369:0:12467:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1790740432.620373:0:12467:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1790740432 -> 1790740431 00002000:00010000:0.0:1790740432.620375:0:12467:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1790740431 00002000:00010000:0.0:1790740432.620378:0:12467:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1790740432 -> 1790740431 00002000:00010000:0.0:1790740432.620380:0:12467:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1790740432.620440:0:12467:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d98512d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ec599375-3198-45fd-a23a-c5620f07177c+8:2370:x1877727133136512:12345-192.168.203.58@tcp:2:lhsmtool_posix.0 Request processed in 390us (1256us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1790740432.620448:0:12467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 69 00010000:00010000:3.0:1790740432.620770:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598eab52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.620781:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598eab52 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.620802:0:3290:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598eab52 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.620808:0:3290:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87595800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1790740432.620812:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598eab52 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.620820:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598eab52 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.620836:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8f0d944f6500) 00010000:00010000:3.0:1790740432.620839:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740432.620901:0:3290:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598eab52 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.620909:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598eab52 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740432.623799:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740432.623886:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133136768 00000100:00100000:2.0:1790740432.623895:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133136768 00000100:00100000:2.0:1790740432.623946:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 228 00000100:00100000:2.0:1790740432.623956:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1b40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+20:11604:x1877727133136768:12345-192.168.203.58@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1790740432.624022:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598eab59 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.624040:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598eab13 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee787 expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.624062:0:5843:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598eab59 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.624097:0:5843:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598eab13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee787 expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.624108:0:5843:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598eab13 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee787 expref: 20 pid: 5842 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740432.624135:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d98511f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1877727158285952:192.168.203.58@tcp:104: 00000100:00100000:2.0:1790740432.624289:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d813246c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790740432.627113:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740432.627204:0:8506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133136896 00000100:00100000:3.0:1790740432.627214:0:8506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133136896 00010000:00010000:3.0:1790740432.627254:0:8506:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598eab13 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee787 expref: 21 pid: 5842 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740432.627294:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 80 00000100:00100000:3.0:1790740432.627303:0:8506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d87f2d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec599375-3198-45fd-a23a-c5620f07177c+21:2369:x1877727133136896:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790740432.627318:0:8506:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740432.627324:0:8506:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598eab13 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee787 expref: 21 pid: 5842 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.627355:0:8506:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598eab13 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee787 expref: 21 pid: 5842 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.627376:0:8506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8f0d944f6500) 00010000:00010000:3.0:1790740432.627382:0:8506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598eab59 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.627392:0:8506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598eab59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.627398:0:8506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598eab59 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.627418:0:8506:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790740432.627475:0:8506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d87f2d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec599375-3198-45fd-a23a-c5620f07177c+21:2369:x1877727133136896:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 173us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740432.627482:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 80 00010000:00010000:2.0:1790740432.627932:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598eab13 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee787 expref: 20 pid: 5842 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740432.627950:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d98511f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1877727158285952:192.168.203.58@tcp:104: 00010000:00010000:2.0:1790740432.627971:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598eab59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.627980:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598eab59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.627986:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598eab59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.628013:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598eab59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.628019:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598eab59 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.628026:0:5843:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598eab59 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.628031:0:5843:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87594e00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740432.628036:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598eab59 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.628068:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598eab59 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.628131:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8f0d944f6500) 00010000:00010000:2.0:1790740432.628134:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1790740432.628177:0:5843:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598eab59 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.628234:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594e00/0xc6b31a1b598eab59 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740432.628328:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1b40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+19:11604:x1877727133136768:12345-192.168.203.58@tcp:55:lhsmtool_posix.0 Request processed in 4373us (4535us total) trans 0 rc -22/-22 00000100:00100000:2.0:1790740432.628337:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 228 00000100:00100000:1.0:1790740432.635404:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740432.635504:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133137024 00000100:00100000:2.0:1790740432.635514:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133137024 00000100:00100000:2.0:1790740432.635660:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 70 00000100:00100000:2.0:1790740432.635671:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec599375-3198-45fd-a23a-c5620f07177c+8:2370:x1877727133137024:12345-192.168.203.58@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1790740432.635714:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e9c266c8/0xc6b31a1b598eab60 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.635737:0:6700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006fd3a7db/0xc6b31a1b598eab3d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee7a3 expref: 8 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.635745:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790740432.635749:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790740432.635754:0:6700:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9c266c8/0xc6b31a1b598eab60 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.635802:0:6700:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006fd3a7db/0xc6b31a1b598eab3d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee7a3 expref: 8 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.635816:0:6700:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006fd3a7db/0xc6b31a1b598eab3d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee7a3 expref: 8 pid: 6699 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740432.635832:0:6700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d98511f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6700:1877727158286080:192.168.203.58@tcp:104: 00000100:00100000:2.0:1790740432.636762:0:6700:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d813246c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790740432.644841:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740432.645151:0:6700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d98511f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6700:1877727158286080:192.168.203.58@tcp:104: 00010000:00010000:2.0:1790740432.645193:0:6700:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e9c266c8/0xc6b31a1b598eab60 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740432.645551:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133137152 00000100:00100000:3.0:1790740432.645559:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133137152 00010000:00010000:3.0:1790740432.645644:0:5828:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006fd3a7db/0xc6b31a1b598eab3d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee7a3 expref: 9 pid: 6699 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740432.645721:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 81 00000100:00100000:0.0:1790740432.645734:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1b43800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec599375-3198-45fd-a23a-c5620f07177c+9:2370:x1877727133137152:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790740432.645749:0:5829:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740432.645770:0:5829:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006fd3a7db/0xc6b31a1b598eab3d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee7a3 expref: 9 pid: 6699 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740432.645784:0:5829:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006fd3a7db/0xc6b31a1b598eab3d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee7a3 expref: 9 pid: 6699 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740432.645825:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006fd3a7db/0xc6b31a1b598eab3d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee7a3 expref: 9 pid: 6699 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740432.645866:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790740432.645871:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790740432.645876:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e9c266c8/0xc6b31a1b598eab60 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740432.645887:0:5829:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9c266c8/0xc6b31a1b598eab60 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740432.645948:0:5829:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740432.646015:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1b43800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec599375-3198-45fd-a23a-c5620f07177c+8:2370:x1877727133137152:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 284us (1181us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740432.646024:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 81 00010000:00010000:3.0:1790740432.647016:0:6700:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e9c266c8/0xc6b31a1b598eab60 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.647030:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9c266c8/0xc6b31a1b598eab60 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.647097:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e9c266c8/0xc6b31a1b598eab60 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.647107:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9c266c8/0xc6b31a1b598eab60 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.647115:0:6700:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9c266c8/0xc6b31a1b598eab60 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.647124:0:6700:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87594e00 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:3.0:1790740432.647129:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9c266c8/0xc6b31a1b598eab60 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.647144:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9c266c8/0xc6b31a1b598eab60 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.647159:0:6700:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9c266c8/0xc6b31a1b598eab60 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.647167:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9c266c8/0xc6b31a1b598eab60 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740432.647239:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec599375-3198-45fd-a23a-c5620f07177c+7:2370:x1877727133137024:12345-192.168.203.58@tcp:1:lhsmtool_posix.0 Request processed in 11568us (11843us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740432.647248:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 70 00000100:00100000:1.0:1790740432.654438:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740432.654538:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133137408 00000100:00100000:3.0:1790740432.654548:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133137408 00000100:00100000:2.0:1790740432.654941:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 229 00000100:00100000:2.0:1790740432.654955:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+19:11604:x1877727133137408:12345-192.168.203.58@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1790740432.655027:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598eab67 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.655140:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598eab67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.655153:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598eab67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.655406:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598eab6e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.655437:0:8666:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598eab21 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee78e expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.655445:0:8666:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598eab6e lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.655478:0:8666:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598eab21 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee78e expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.655493:0:8666:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598eab21 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee78e expref: 20 pid: 5842 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740432.655508:0:8666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d98511f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8666:1877727158286208:192.168.203.58@tcp:104: 00000100:00100000:2.0:1790740432.655841:0:8666:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d813246c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790740432.659198:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740432.659255:0:8506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133137536 00000100:00100000:3.0:1790740432.659263:0:8506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133137536 00010000:00010000:3.0:1790740432.659491:0:8506:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598eab21 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee78e expref: 21 pid: 5842 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740432.659534:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 82 00000100:00100000:3.0:1790740432.659545:0:8506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec599375-3198-45fd-a23a-c5620f07177c+21:2370:x1877727133137536:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790740432.659561:0:8506:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740432.659568:0:8506:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598eab21 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee78e expref: 21 pid: 5842 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.659606:0:8506:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598eab21 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee78e expref: 21 pid: 5842 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.660516:0:8506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8f0d944f6500) 00010000:00010000:3.0:1790740432.660525:0:8506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598eab6e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.660535:0:8506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598eab6e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.660543:0:8506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598eab6e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.660567:0:8506:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790740432.660913:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598eab21 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee78e expref: 21 pid: 5842 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740432.660935:0:8666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d98511f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8666:1877727158286208:192.168.203.58@tcp:104: 00010000:00010000:2.0:1790740432.660955:0:8666:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598eab6e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.660965:0:8666:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598eab6e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740432.660971:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598eab6e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740432.661013:0:8506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec599375-3198-45fd-a23a-c5620f07177c+20:2370:x1877727133137536:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 1469us (1821us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740432.661025:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 82 00000001:00080000:2.0:1790740432.661272:0:8666:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1790740432.661426:0:8666:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:2.0:1790740432.661471:0:8666:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1790740432.661936:0:8666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d98511f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8666:1877727158286336:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1790740432.661988:0:8666:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740432.662009:0:8666:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d813240c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790740432.662488:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158286336 00000100:00100000:0.0:1790740432.662496:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158286336 00000100:00100000:0.0:1790740432.662544:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790740432.662556:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d98511880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8666:x1877727158286336:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1790740432.662800:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d98511880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8666:x1877727158286336:12345-0@lo:1000:mdt00_003.0 Request processed in 248us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740432.662808:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790740432.662884:0:8666:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:2.0:1790740432.662889:0:8666:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:2.0:1790740432.662905:0:8666:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f0dbda77b80, transno 4294967321 00000100:00100000:2.0:1790740432.662924:0:8666:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8f0dbda75180 x1877727158285440/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1790740448 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740432.662936:0:8666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d98511f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8666:1877727158286336:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1790740432.663832:0:8666:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:2.0:1790740432.663907:0:8666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d98511f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8666:1877727158286464:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1790740432.663951:0:8666:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740432.663981:0:8666:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d813246c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790740432.668400:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158286464 00000100:00100000:1.0:1790740432.668414:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158286464 00000100:00100000:1.0:1790740432.668485:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790740432.668495:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d98513b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8666:x1877727158286464:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1790740432.668821:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d98513b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:8666:x1877727158286464:12345-0@lo:1000:mdt00_003.0 Request processed in 327us (4868us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1790740432.668829:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790740432.669541:0:8666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d98511f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8666:1877727158286464:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1790740432.669602:0:8666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598eab6e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.669614:0:8666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598eab6e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.669621:0:8666:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598eab6e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.669628:0:8666:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87595800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1790740432.669632:0:8666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598eab6e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.669640:0:8666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598eab6e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.669654:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8f0d944f6500) 00010000:00010000:3.0:1790740432.669658:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790740432.669662:0:8666:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598eab6e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.669668:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595800/0xc6b31a1b598eab6e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.669699:0:8666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598eaab1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.669705:0:8666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598eaab1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.669711:0:8666:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598eaab1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.669728:0:8666:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f977800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1790740432.669731:0:8666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598eaab1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.669737:0:8666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598eaab1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.669746:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f0d98dcc000) 00010000:00010000:3.0:1790740432.669748:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790740432.669755:0:8666:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598eaab8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee772 expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.669766:0:8666:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598eaab8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee772 expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.669775:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598eaab8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee772 expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.669808:0:8666:0:(ldlm_lockd.c:1085:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598eaab8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee772 expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740432.669822:0:8666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd7d7100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8666:1877727158286592:192.168.203.58@tcp:105: 00000100:00100000:3.0:1790740432.670084:0:8666:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0dbd398f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790740432.674727:0:8666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd7d7100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8666:1877727158286592:192.168.203.58@tcp:105: 00010000:00010000:3.0:1790740432.674760:0:8666:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598eaab1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740432.674774:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00010000:00010000:3.0:1790740432.674789:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598eaab1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.674825:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fe00/0xc6b31a1b598eab75 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.674840:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fe00/0xc6b31a1b598eab75 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.674850:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fe00/0xc6b31a1b598eab75 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.674860:0:8666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fe00/0xc6b31a1b598eab75 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.674864:0:8666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fe00/0xc6b31a1b598eab75 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.674869:0:8666:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fe00/0xc6b31a1b598eab75 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.674872:0:8666:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0fe00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1790740432.674875:0:8666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fe00/0xc6b31a1b598eab75 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.674880:0:8666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fe00/0xc6b31a1b598eab75 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.674887:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f0d98dcc000) 00010000:00010000:3.0:1790740432.674889:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790740432.674892:0:8666:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fe00/0xc6b31a1b598eab75 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.674900:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fe00/0xc6b31a1b598eab75 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.674909:0:8666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598eab67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.674912:0:8666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598eab67 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.674916:0:8666:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598eab67 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.674919:0:8666:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87594800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1790740432.674920:0:8666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598eab67 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.674923:0:8666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598eab67 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.674928:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f0d98dcc000) 00010000:00010000:3.0:1790740432.674929:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790740432.674930:0:8666:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598eab67 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.674933:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594800/0xc6b31a1b598eab67 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740432.675099:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133137664 00000100:00100000:0.0:1790740432.675107:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133137664 00000100:00100000:0.0:1790740432.675161:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 61 00000100:00100000:0.0:1790740432.675170:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+24:11602:x1877727133137664:12345-192.168.203.58@tcp:49:lfs.0 00000100:00100000:0.0:1790740432.675316:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+24:11602:x1877727133137664:12345-192.168.203.58@tcp:49:lfs.0 Request processed in 147us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740432.675325:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 61 00000100:00100000:3.0:1790740432.678795:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+23:11604:x1877727133137408:12345-192.168.203.58@tcp:57:lhsmtool_posix.0 Request processed in 23834us (24355us total) trans 4294967513 rc 0/0 00000100:00100000:3.0:1790740432.678809:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 229 00000020:00080000:3.0:1790740432.678830:0:8666:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1790740432.679079:0:11679:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790740432.679084:0:11679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790740432.679563:0:11679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1790740432.679615:0:11679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790740432.682176:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740432.682637:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133137920 00000100:00100000:3.0:1790740432.682647:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133137920 00000100:00100000:3.0:1790740432.682696:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 230 00000100:00100000:3.0:1790740432.682706:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1a3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+23:11602:x1877727133137920:12345-192.168.203.58@tcp:58:lfs.0 00000040:00080000:3.0:1790740432.683036:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1790740432.683126:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1a3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+23:11602:x1877727133137920:12345-192.168.203.58@tcp:58:lfs.0 Request processed in 422us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740432.683134:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 230 00000100:00100000:1.0:1790740432.687508:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740432.687628:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133138176 00000100:00100000:0.0:1790740432.687637:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133138176 00000100:00100000:0.0:1790740432.687692:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 62 00000100:00100000:0.0:1790740432.687702:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0da2039450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+23:11604:x1877727133138176:12345-192.168.203.58@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1790740432.688365:0:5846:0:(mdd_object.c:4180:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1790740432.688468:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967514 00010000:00010000:0.0:1790740432.689080:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fe00/0xc6b31a1b598eab7c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740432.689098:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fe00/0xc6b31a1b598eab7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740432.689109:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fe00/0xc6b31a1b598eab7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740432.689117:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fe00/0xc6b31a1b598eab7c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740432.689123:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fe00/0xc6b31a1b598eab7c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740432.689128:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fe00/0xc6b31a1b598eab7c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740432.689156:0:5846:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1790740432.689250:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0da2039450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+25:11604:x1877727133138176:12345-192.168.203.58@tcp:35:lhsmtool_posix.0 Request processed in 1547us (1749us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1790740432.689259:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 62 00000020:00080000:0.0:1790740432.689266:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790740432.689519:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790740432.689527:0:5832:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fe00/0xc6b31a1b598eab7c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740432.689533:0:5832:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132fe00 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:1.0:1790740432.689537:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fe00/0xc6b31a1b598eab7c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740432.689545:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fe00/0xc6b31a1b598eab7c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740432.689557:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8f0d82841f00) 00010000:00010000:1.0:1790740432.689566:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1790740432.689610:0:5832:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fe00/0xc6b31a1b598eab7c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740432.689618:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fe00/0xc6b31a1b598eab7c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740432.690912:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d98510a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158286720:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790740432.691129:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740432.691186:0:6703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158286720 00000100:00100000:0.0:1790740432.691194:0:6703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158286720 00000100:00100000:0.0:1790740432.691242:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1790740432.691251:0:6703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd7d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1877727158286720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790740432.691272:0:6703:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1790740432.691314:0:6703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd7d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1877727158286720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740432.691321:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1790740432.691367:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d98510a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158286720:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790740432.692375:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740432.692382:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740432.692385:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740432.730907:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740432.731005:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133138304 00000100:00100000:3.0:1790740432.731014:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133138304 00000100:00100000:3.0:1790740432.731085:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 231 00000100:00100000:3.0:1790740432.731095:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1a3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+25:11606:x1877727133138304:12345-192.168.203.58@tcp:101:lfs.0 00010000:00010000:3.0:1790740432.731117:0:5844:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740432.731137:0:5844:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ec00/0xc6b31a1b598eab83 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee7aa expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.731223:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fe00/0xc6b31a1b598eab8a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.731239:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fe00/0xc6b31a1b598eab8a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.731251:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fe00/0xc6b31a1b598eab8a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.731265:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fa00/0xc6b31a1b598eab91 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.731280:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fa00/0xc6b31a1b598eab91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.731288:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fa00/0xc6b31a1b598eab91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.731517:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598eab98 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.731530:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598eaaa3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee76b expref: 26 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.731538:0:5844:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598eab98 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.731609:0:5844:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598eaaa3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee76b expref: 26 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740432.731624:0:5844:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598eaaa3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee76b expref: 26 pid: 5842 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740432.731636:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd7d7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1877727158286848:192.168.203.58@tcp:104: 00000100:00100000:3.0:1790740432.731914:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0dbd398f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790740432.737721:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd7d7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1877727158286848:192.168.203.58@tcp:104: 00010000:00010000:1.0:1790740432.737754:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598eab98 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740432.739067:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740432.739610:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133138560 00000100:00100000:2.0:1790740432.739619:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133138560 00000100:00100000:2.0:1790740432.739680:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 63 00000100:00100000:2.0:1790740432.739690:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec599375-3198-45fd-a23a-c5620f07177c+27:5608:x1877727133138560:12345-192.168.203.58@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1790740432.739910:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec599375-3198-45fd-a23a-c5620f07177c+28:5608:x1877727133138560:12345-192.168.203.58@tcp:35:ldlm_bl.0 Request processed in 221us (856us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1790740432.739919:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 63 00000100:00100000:3.0:1790740432.744844:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740432.744917:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133138688 00000100:00100000:0.0:1790740432.744928:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133138688 00010000:00010000:0.0:1790740432.744968:0:5829:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598eaaa3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee76b expref: 28 pid: 5842 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740432.745007:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 83 00000100:00100000:0.0:1790740432.745015:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd7d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec599375-3198-45fd-a23a-c5620f07177c+28:2370:x1877727133138688:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790740432.745028:0:5829:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740432.745034:0:5829:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598eaaa3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee76b expref: 28 pid: 5842 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740432.745075:0:5829:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598eaaa3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee76b expref: 28 pid: 5842 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740432.745099:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594400/0xc6b31a1b598eaaa3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee76b expref: 28 pid: 5842 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740432.745116:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f0d98dcc000) 00010000:00010000:0.0:1790740432.745121:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598eab98 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740432.745132:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598eab98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740432.745139:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598eab98 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740432.745291:0:5829:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740432.745364:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd7d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec599375-3198-45fd-a23a-c5620f07177c+27:2370:x1877727133138688:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 349us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740432.745372:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 83 00010000:00010000:1.0:1790740432.746899:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598eab98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740432.746914:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598eab98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790740432.747012:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1790740432.747017:0:5844:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790740432.747038:0:5844:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598eab98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740432.747051:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598eab98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740432.747076:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fe00/0xc6b31a1b598eab8a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740432.747100:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fe00/0xc6b31a1b598eab8a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740432.747106:0:5844:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fe00/0xc6b31a1b598eab8a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740432.747112:0:5844:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0fe00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1790740432.747116:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fe00/0xc6b31a1b598eab8a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740432.747124:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fe00/0xc6b31a1b598eab8a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740432.747136:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f0d98dccd00) 00010000:00010000:0.0:1790740432.747139:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740432.747143:0:5844:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fe00/0xc6b31a1b598eab8a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740432.747148:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fe00/0xc6b31a1b598eab8a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740432.747163:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fa00/0xc6b31a1b598eab91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740432.747168:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fa00/0xc6b31a1b598eab91 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740432.747173:0:5844:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fa00/0xc6b31a1b598eab91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740432.747177:0:5844:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0fa00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1790740432.747199:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fa00/0xc6b31a1b598eab91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740432.747206:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fa00/0xc6b31a1b598eab91 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740432.747221:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8f0d944f6500) 00010000:00010000:0.0:1790740432.747223:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740432.747226:0:5844:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fa00/0xc6b31a1b598eab91 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740432.747232:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fa00/0xc6b31a1b598eab91 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740432.747273:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ec00/0xc6b31a1b598eab83 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee7aa expref: 27 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740432.747287:0:5844:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598eab98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee7aa expref: 26 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740432.747294:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f0d98dcc000) 00010000:00010000:0.0:1790740432.747297:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790740432.747299:0:5844:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0db6c0f600, rc 0) 00000100:00100000:0.0:1790740432.747774:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1a3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec599375-3198-45fd-a23a-c5620f07177c+26:11606:x1877727133138304:12345-192.168.203.58@tcp:101:lfs.0 Request processed in 16679us (16874us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740432.747783:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 231 00000100:00100000:3.0:1790740432.781879:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740432.781983:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740432.782019:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740432.782148:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133139072 00000100:00100000:2.0:1790740432.782158:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133139072 00000100:00100000:2.0:1790740432.782212:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 157 00000100:00100000:2.0:1790740432.782220:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd7d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+5:2370:x1877727133139072:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:2.0:1790740432.782301:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd7d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+5:2370:x1877727133139072:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 81us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740432.782308:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 157 00000100:00080000:2.0:1790740432.782327:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790740432.786530:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133138944 00000100:00100000:0.0:1790740432.786545:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133138944 00000100:00100000:0.0:1790740432.786770:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 91 00000100:00100000:0.0:1790740432.786782:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8498d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec599375-3198-45fd-a23a-c5620f07177c+7:2370:x1877727133138944:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:0.0:1790740432.786884:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8498d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec599375-3198-45fd-a23a-c5620f07177c+7:2370:x1877727133138944:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 105us (4863us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740432.786891:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 91 00000100:00100000:1.0:1790740432.786894:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133138816 00000100:00100000:1.0:1790740432.786900:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133138816 00000100:00100000:1.0:1790740432.786935:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 298 00000100:00100000:1.0:1790740432.786942:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:2370:x1877727133138816:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:1.0:1790740432.787677:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:2370:x1877727133138816:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 730us (5802us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740432.787686:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 298 00000100:00100000:3.0:1790740433.203778:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d98510a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158286976:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790740433.203905:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740433.203941:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158286976 00000100:00100000:0.0:1790740433.203953:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158286976 00000100:00080000:2.0:1790740433.204011:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790740433.204023:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1790740433.204035:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8498c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3304:x1877727158286976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790740433.204093:0:6704:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00010000:00010000:2.0:1790740433.204933:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740433.205130:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8498c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3304:x1877727158286976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1095us (1222us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740433.205142:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1790740433.205232:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d98510a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158286976:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1790740433.640929:0:12505:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790740433.640944:0:12505:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790740433.640993:0:12505:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1790740433.640998:0:12505:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1790740433.715830:0:11679:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790740433.715840:0:11679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790740433.715898:0:11679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1790740433.715904:0:11679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790740433.716027:0:11679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d901de300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11679:1877727158287104:192.168.203.58@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790740433.716146:0:11679:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0dbd398a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790740433.720123:0:11679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d901de300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11679:1877727158287104:192.168.203.58@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790740433.723937:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740433.723973:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133139200 00000100:00100000:2.0:1790740433.723983:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133139200 00000100:00100000:2.0:1790740433.724040:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 232 00000100:00100000:2.0:1790740433.724062:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d98511180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+26:11618:x1877727133139200:12345-192.168.203.58@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790740433.724098:0:8666:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790740433.724196:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d98511180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+26:11618:x1877727133139200:12345-192.168.203.58@tcp:53:lhsmtool_posix.0 Request processed in 146us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740433.724204:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 232 00000100:00080000:2.0:1790740433.724226:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790740433.728283:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740433.728374:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133139456 00000100:00100000:0.0:1790740433.728384:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133139456 00000100:00100000:0.0:1790740433.728440:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 233 00000100:00100000:0.0:1790740433.728450:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1a40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+26:11618:x1877727133139456:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790740433.728469:0:5842:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740433.728489:0:5842:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e400/0xc6b31a1b598eab9f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee7b1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740433.728708:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e000/0xc6b31a1b598eaba6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740433.728725:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e000/0xc6b31a1b598eaba6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740433.728736:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e000/0xc6b31a1b598eaba6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790740433.728754:0:5842:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1790740433.728869:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e400/0xc6b31a1b598eab9f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee7b1 expref: 29 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740433.728887:0:5842:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e000/0xc6b31a1b598eaba6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee7b1 expref: 28 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740433.728895:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f0d98dcc000) 00010000:00010000:0.0:1790740433.728899:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790740433.728902:0:5842:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0dc132e000, rc 0) 00000100:00100000:0.0:1790740433.728966:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1a40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+28:11618:x1877727133139456:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 Request processed in 517us (694us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1790740433.728973:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 233 00000100:00100000:0.0:1790740433.736265:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740433.736343:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133139584 00000100:00100000:2.0:1790740433.736352:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133139584 00000100:00100000:2.0:1790740433.736415:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 17 00000100:00100000:2.0:1790740433.736425:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1b40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec599375-3198-45fd-a23a-c5620f07177c+28:2371:x1877727133139584:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790740433.736440:0:5830:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740433.736464:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e000/0xc6b31a1b598eaba6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee7b1 expref: 28 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740433.736484:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f0d98dcc000) 00010000:00010000:2.0:1790740433.736489:0:5830:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790740433.736553:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1b40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec599375-3198-45fd-a23a-c5620f07177c+27:2371:x1877727133139584:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 129us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740433.736561:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 17 00000100:00100000:1.0:1790740433.737949:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740433.738127:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133139840 00000100:00100000:3.0:1790740433.738144:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133139840 00000100:00100000:3.0:1790740433.738215:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 234 00000100:00100000:3.0:1790740433.738226:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8812df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+27:11618:x1877727133139840:12345-192.168.203.58@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1790740433.738333:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598eabb4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740433.738652:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598eabb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740433.738671:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598eabb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740433.738958:0:8666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598eabb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740433.738968:0:8666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598eabb4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740433.738978:0:8666:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598eabb4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740433.739431:0:8666:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0f000 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1790740433.739437:0:8666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598eabb4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740433.739446:0:8666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598eabb4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740433.739465:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f0d98dcc000) 00010000:00010000:3.0:1790740433.739468:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790740433.739474:0:8666:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598eabb4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740433.739481:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598eabb4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740433.739753:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8812df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+28:11618:x1877727133139840:12345-192.168.203.58@tcp:57:lhsmtool_posix.0 Request processed in 1523us (1804us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1790740433.739765:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 234 00000040:00080000:3.0:1790740433.742219:0:11679:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790740433.742232:0:11679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790740433.742765:0:11679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1790740433.742780:0:11679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790740433.747702:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740433.747812:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133140096 00000100:00100000:1.0:1790740433.747825:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133140096 00000100:00100000:1.0:1790740433.747926:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 64 00000100:00100000:1.0:1790740433.747938:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1b41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+28:11618:x1877727133140096:12345-192.168.203.58@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1790740433.748275:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1b41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+29:11618:x1877727133140096:12345-192.168.203.58@tcp:35:lhsmtool_posix.0 Request processed in 338us (584us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1790740433.748285:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 64 00000001:00080000:3.0:1790740433.776448:0:6725:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:3.0:1790740433.776469:0:6725:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00010000:00010000:3.0:1790740434.224909:0:11661:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740435.251977:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790740435.588406:0:12557:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790740435.588422:0:12557:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790740435.588473:0:12557:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1790740435.588480:0:12557:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790740435.797413:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740435.801885:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133140352 00000100:00100000:1.0:1790740435.801906:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133140352 00000100:00100000:1.0:1790740435.802061:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 235 00000100:00100000:1.0:1790740435.802075:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1b42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+29:11638:x1877727133140352:12345-192.168.203.58@tcp:101:lfs.0 00010000:00010000:1.0:1790740435.802109:0:5843:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740435.802138:0:5843:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598eabbb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee7b8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1790740435.802285:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790740435.802394:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598eabc2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740435.802431:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598eabc2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740435.802447:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598eabc2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790740435.802537:0:5843:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1790740435.803003:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598eabbb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee7b8 expref: 32 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740435.803047:0:5843:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598eabc2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee7b8 expref: 31 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740435.803059:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f0d98dcc000) 00010000:00010000:1.0:1790740435.803062:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1790740435.803067:0:5843:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9f976000, rc 0) 00000100:00100000:1.0:1790740435.803224:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1b42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec599375-3198-45fd-a23a-c5620f07177c+31:11638:x1877727133140352:12345-192.168.203.58@tcp:101:lfs.0 Request processed in 1152us (5830us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1790740435.803235:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 235 00000100:00100000:0.0:1790740435.816156:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740435.818348:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133140480 00000100:00100000:1.0:1790740435.818368:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133140480 00000100:00100000:1.0:1790740435.818450:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 236 00000100:00100000:1.0:1790740435.818461:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1b41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+31:11638:x1877727133140480:12345-192.168.203.58@tcp:54:lfs.0 00010000:00010000:1.0:1790740435.818546:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598eabd0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740435.818594:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598eabd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740435.818621:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598eabd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740435.818653:0:8666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598eabd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740435.818661:0:8666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598eabd0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740435.818669:0:8666:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598eabd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740435.818676:0:8666:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f977800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1790740435.818681:0:8666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598eabd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740435.818689:0:8666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598eabd0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740435.818716:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f0d98dcc000) 00010000:00010000:1.0:1790740435.818720:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790740435.818726:0:8666:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598eabd0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740435.818733:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977800/0xc6b31a1b598eabd0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740435.819051:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1b41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+31:11638:x1877727133140480:12345-192.168.203.58@tcp:54:lfs.0 Request processed in 590us (2908us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740435.819062:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 236 00000100:00100000:2.0:1790740435.928960:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740435.929087:0:12467:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133140608 00000100:00100000:0.0:1790740435.929102:0:12467:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133140608 00000100:00100000:0.0:1790740435.929212:0:12467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 71 00000100:00100000:0.0:1790740435.929226:0:12467:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d98510a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ec599375-3198-45fd-a23a-c5620f07177c+7:2370:x1877727133140608:12345-192.168.203.58@tcp:101:cat.0 00010000:00010000:0.0:1790740435.929250:0:12467:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740435.929278:0:12467:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005859c61d/0xc6b31a1b598eabd7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee7bf expref: -99 pid: 12467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790740435.929310:0:12467:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6abc87cf, atime: 0x6abc87cf, ctime: 0x6abc87cf, blocks: 0xb 00010000:00010000:0.0:1790740435.929354:0:12467:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=351s v=(0 0) 00010000:00010000:0.0:1790740435.929359:0:12467:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740435.929372:0:12467:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005859c61d/0xc6b31a1b598eabd7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee7bf expref: 8 pid: 12467 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740435.929393:0:12467:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005859c61d/0xc6b31a1b598eabd7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee7bf expref: 8 pid: 12467 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740435.929410:0:12467:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0dc132e200, rc 0) 00000100:00100000:0.0:1790740435.929493:0:12467:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d98510a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ec599375-3198-45fd-a23a-c5620f07177c+8:2370:x1877727133140608:12345-192.168.203.58@tcp:101:cat.0 Request processed in 270us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740435.929500:0:12467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 71 00000100:00080000:2.0:1790740435.929616:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790740435.933404:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740435.933607:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133140736 00000100:00100000:2.0:1790740435.933621:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133140736 00002000:00100000:2.0:1790740435.933688:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff8f0dc12e6d80 x1877727133140736/t0(0) o3->ec599375-3198-45fd-a23a-c5620f07177c@192.168.203.58@tcp:491/0 lens 488/0 e 0 to 0 dl 1790740446 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790740435.933701:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f0dc12e6d80 with x1877727133140736 ext(0->4095) 00002000:00010000:2.0:1790740435.933708:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f0dc12e6d80 00000100:00100000:2.0:1790740435.933748:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 7 00000100:00100000:2.0:1790740435.933759:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc12e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ec599375-3198-45fd-a23a-c5620f07177c+8:2369:x1877727133140736:12345-192.168.203.58@tcp:3:cat.0 00000100:00100000:2.0:1790740435.934074:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc12e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ec599375-3198-45fd-a23a-c5620f07177c+8:2369:x1877727133140736:12345-192.168.203.58@tcp:3:cat.0 Request processed in 316us (686us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1790740435.934083:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 7 00002000:00100000:2.0:1790740435.934090:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff8f0dc12e6d80 x1877727133140736/t0(0) o3->ec599375-3198-45fd-a23a-c5620f07177c@192.168.203.58@tcp:491/0 lens 488/4536 e 0 to 0 dl 1790740446 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790740435.934099:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f0dc12e6d80 with x1877727133140736 ext(0->4095) 00002000:00010000:2.0:1790740435.934103:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f0dc12e6d80 00010000:00010000:2.0:1790740436.272907:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740437.297186:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1b43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877727158287360:0@lo:400:kworker.0 00000100:00100000:2.0:1790740437.297201:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1b43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158287616:0@lo:400:kworker.0 00000100:00100000:1.0:1790740437.297296:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1b41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3305:1877727158287232:0@lo:400:kworker.0 00000100:00100000:0.0:1790740437.300183:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740437.300264:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1b40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158287872:0@lo:400:kworker.0 00000100:00100000:0.0:1790740437.300305:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740437.300362:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1b42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1877727158287488:0@lo:400:kworker.0 00000100:00100000:0.0:1790740437.300405:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740437.300449:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158287360 00000100:00100000:0.0:1790740437.300459:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158287360 00000100:00100000:0.0:1790740437.300509:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158287488 00000100:00100000:0.0:1790740437.300513:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158287488 00000100:00100000:0.0:1790740437.300544:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1790740437.301323:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877727158287360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740437.301406:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877727158287360:12345-0@lo:400:kworker.0 Request processed in 89us (1233us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740437.301424:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1790740437.302622:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740437.302684:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1b40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1877727158287744:0@lo:400:kworker.0 00000100:00100000:1.0:1790740437.302722:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740437.302772:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1790740437.302788:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0c86431f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1877727158287488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740437.302820:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158287744 00000100:00100000:1.0:1790740437.302829:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158287744 00000100:00100000:0.0:1790740437.302849:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0c86431f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1877727158287488:12345-0@lo:400:kworker.0 Request processed in 68us (2444us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740437.302856:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1790740437.302866:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1790740437.302872:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc12e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877727158287744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740437.302883:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158287872 00000100:00100000:0.0:1790740437.302887:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158287872 00000100:00100000:1.0:1790740437.302909:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc12e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877727158287744:12345-0@lo:400:kworker.0 Request processed in 37us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740437.302915:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1790740437.302920:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1790740437.302926:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3306:x1877727158287872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740437.302934:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158287232 00000100:00100000:1.0:1790740437.302937:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158287232 00000100:00100000:1.0:1790740437.302961:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1790740437.302963:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3306:x1877727158287872:12345-0@lo:400:kworker.0 Request processed in 37us (2656us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740437.302967:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3305:x1877727158287232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740437.302969:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:0.0:1790740437.302992:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790740437.302996:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3305:x1877727158287232:12345-0@lo:400:kworker.0 Request processed in 30us (382us total) trans 0 rc 0/0 00000100:00080000:0.0:1790740437.302997:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790740437.303002:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00010000:00010000:1.0:1790740437.303040:0:11661:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740437.303058:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1b42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1877727158287488:0@lo:400:kworker.0 00000100:00100000:1.0:1790740437.303067:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1b41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3305:1877727158287232:0@lo:400:kworker.0 00000100:00100000:1.0:1790740437.303079:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1b40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1877727158287744:0@lo:400:kworker.0 00000100:00100000:1.0:1790740437.303372:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1b43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877727158287360:0@lo:400:kworker.0 00000100:00100000:1.0:1790740437.303385:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1b40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158287872:0@lo:400:kworker.0 00000100:00100000:2.0:1790740437.306042:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740437.306308:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158287616 00000100:00100000:1.0:1790740437.306329:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158287616 00000100:00100000:1.0:1790740437.306407:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1790740437.306420:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158287616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740437.306496:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158287616:12345-0@lo:400:kworker.0 Request processed in 80us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740437.306505:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:2.0:1790740437.310760:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790740437.310838:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1790740437.310869:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f0dbee5d880, transno 4294967307 00000004:00080000:2.0:1790740437.310901:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:2.0:1790740437.310928:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f0dbda76a00, transno 4294967310 00000100:00100000:2.0:1790740437.310940:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1b43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158287616:0@lo:400:kworker.0 00000100:00100000:0.0:1790740437.814552:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d901dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158288000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790740437.814690:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740437.816216:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158288000 00000100:00100000:0.0:1790740437.816232:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158288000 00000100:00100000:0.0:1790740437.816297:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1790740437.816308:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0c86432a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1877727158288000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790740437.816370:0:6704:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790740437.818041:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0c86432a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1877727158288000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1726us (3343us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740437.818068:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790740437.819620:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d901dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158288000:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1790740437.879062:0:7642:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:1.0:1790740437.879089:0:7642:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:3.0:1790740437.892072:0:5865:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967517 is committed 00000001:00080000:3.0:1790740437.892109:0:5865:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:3.0:1790740437.892138:0:5865:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:3.0:1790740437.892160:0:5865:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f0d81324300 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1790740437.892166:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f0d91c88b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f0d817a83c0 00000020:00080000:3.0:1790740437.892170:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f0d91c88f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f0dbd05c800 00000020:00080000:3.0:1790740437.892310:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1790740437.892936:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:0.0:1790740437.904473:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740437.904528:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740437.904597:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740437.904624:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740437.904649:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740437.904696:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133141376 00000100:00100000:0.0:1790740437.904709:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133141376 00000100:00100000:0.0:1790740437.904786:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133140992 00000100:00100000:0.0:1790740437.904790:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133140992 00000100:00100000:0.0:1790740437.904818:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 161 00000100:00100000:0.0:1790740437.904830:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0c86431500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+5:2372:x1877727133141376:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:0.0:1790740437.904927:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0c86431500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+5:2372:x1877727133141376:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 99us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740437.904937:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 161 00000100:00100000:0.0:1790740437.904960:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 162 00000100:00100000:0.0:1790740437.904967:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0c86433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+18:2372:x1877727133140992:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:0.0:1790740437.904994:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0c86433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+18:2372:x1877727133140992:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 28us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740437.904999:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 162 00000100:00100000:0.0:1790740437.905037:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133141120 00000100:00100000:0.0:1790740437.905041:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133141120 00000100:00100000:0.0:1790740437.905068:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133141248 00000100:00100000:0.0:1790740437.905072:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133141248 00000100:00100000:0.0:1790740437.905092:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 94 00000100:00100000:0.0:1790740437.905099:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0c86431c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec599375-3198-45fd-a23a-c5620f07177c+5:2372:x1877727133141120:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:0.0:1790740437.905143:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0c86431c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec599375-3198-45fd-a23a-c5620f07177c+5:2372:x1877727133141120:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 44us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740437.905149:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 94 00000100:00100000:0.0:1790740437.905162:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 95 00000100:00100000:0.0:1790740437.905168:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0c86432d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec599375-3198-45fd-a23a-c5620f07177c+7:2372:x1877727133141248:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:0.0:1790740437.905191:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0c86432d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec599375-3198-45fd-a23a-c5620f07177c+7:2372:x1877727133141248:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 24us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740437.905198:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 95 00000100:00080000:0.0:1790740437.905216:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790740437.905221:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790740437.905224:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790740437.905517:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133140864 00000100:00100000:2.0:1790740437.905523:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133140864 00000100:00100000:2.0:1790740437.905569:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 300 00000100:00100000:2.0:1790740437.905602:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:2372:x1877727133140864:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:2.0:1790740437.905642:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:2372:x1877727133140864:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 42us (1184us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740437.905649:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 300 00000100:00100000:0.0:1790740438.321451:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d901dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158288128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790740438.321558:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740438.321678:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158288128 00000100:00100000:0.0:1790740438.321687:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158288128 00000100:00100000:0.0:1790740438.321739:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1790740438.321749:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0c86432680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158288128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790740438.321796:0:6704:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790740438.321849:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0c86432680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158288128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740438.321857:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1790740438.321914:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d901dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158288128:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790740438.322352:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740439.351499:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740440.369802:0:11661:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740440.522140:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740440.522265:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133141504 00000100:00100000:2.0:1790740440.522280:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133141504 00000100:00100000:2.0:1790740440.522373:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 237 00000100:00100000:2.0:1790740440.522388:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d901dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+18:11291:x1877727133141504:12345-192.168.203.58@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1790740440.522525:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d901dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+18:11291:x1877727133141504:12345-192.168.203.58@tcp:60:lhsmtool_posix.0 Request processed in 140us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740440.522533:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 237 00000100:00080000:3.0:1790740440.523504:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790740440.526870:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740440.526924:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133141760 00000100:00100000:3.0:1790740440.526937:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133141760 00000100:00100000:3.0:1790740440.527018:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 65 00000100:00100000:3.0:1790740440.527030:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d901df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+18:11291:x1877727133141760:12345-192.168.203.58@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1790740440.527444:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d901df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+19:11291:x1877727133141760:12345-192.168.203.58@tcp:35:lhsmtool_posix.0 Request processed in 415us (590us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1790740440.527454:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 65 00010000:00010000:1.0:1790740441.393170:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790740442.107939:0:12758:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 23:54:01 (1790740441) 00000100:00100000:0.0:1790740442.418364:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0c86433b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877727158288384:0@lo:400:kworker.0 00000100:00100000:0.0:1790740442.418477:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740442.418538:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0c86431880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158288896:0@lo:400:kworker.0 00000100:00100000:0.0:1790740442.418569:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740442.418638:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1790740442.418645:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0c86433100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3306:1877727158288256:0@lo:400:kworker.0 00000100:00100000:0.0:1790740442.418931:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740442.418959:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0c86430e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1877727158288768:0@lo:400:kworker.0 00000100:00100000:0.0:1790740442.418996:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740442.419030:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0c86432300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1877727158288512:0@lo:400:kworker.0 00000100:00100000:0.0:1790740442.419056:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740442.419075:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790740442.419081:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0c86430380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158288640:0@lo:400:kworker.0 00000100:00100000:0.0:1790740442.419102:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740442.419137:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158288384 00000100:00100000:0.0:1790740442.419147:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158288384 00000100:00100000:0.0:1790740442.419196:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158288768 00000100:00100000:0.0:1790740442.419199:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158288768 00000100:00100000:0.0:1790740442.419226:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1790740442.419236:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0c86430a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877727158288384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740442.419300:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0c86430a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877727158288384:12345-0@lo:400:kworker.0 Request processed in 64us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740442.419308:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1790740442.419326:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158288512 00000100:00100000:0.0:1790740442.419328:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158288512 00000100:00100000:0.0:1790740442.419343:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1790740442.419349:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0c86430000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877727158288768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740442.419390:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0c86430000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877727158288768:12345-0@lo:400:kworker.0 Request processed in 41us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740442.419396:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1790740442.419408:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1790740442.419415:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0c86433800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1877727158288512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740442.419446:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0c86433800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1877727158288512:12345-0@lo:400:kworker.0 Request processed in 31us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740442.419452:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1790740442.419470:0:12467:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158288896 00000100:00100000:0.0:1790740442.419473:0:12467:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158288896 00000100:00100000:0.0:1790740442.419499:0:12467:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158288640 00000100:00100000:0.0:1790740442.419502:0:12467:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158288640 00000100:00100000:0.0:1790740442.419520:0:12467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1790740442.419526:0:12467:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0c86431180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3306:x1877727158288896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740442.419558:0:12467:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0c86431180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3306:x1877727158288896:12345-0@lo:400:kworker.0 Request processed in 32us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740442.419564:0:12467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1790740442.419602:0:12467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1790740442.419609:0:12467:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0c86430700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158288640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740442.419636:0:12467:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0c86430700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158288640:12345-0@lo:400:kworker.0 Request processed in 30us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740442.419643:0:12467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1790740442.419662:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158288256 00000100:00100000:0.0:1790740442.419665:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158288256 00000100:00100000:0.0:1790740442.419940:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1790740442.419947:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3306:x1877727158288256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740442.420008:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3306:x1877727158288256:12345-0@lo:400:kworker.0 Request processed in 61us (1077us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740442.420015:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1790740442.420093:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0c86430380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158288640:0@lo:400:kworker.0 00000100:00100000:0.0:1790740442.420104:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0c86432300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1877727158288512:0@lo:400:kworker.0 00000100:00100000:0.0:1790740442.420144:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0c86433100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3306:1877727158288256:0@lo:400:kworker.0 00000100:00100000:0.0:1790740442.420155:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0c86430e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1877727158288768:0@lo:400:kworker.0 00000100:00100000:0.0:1790740442.420167:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0c86433b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877727158288384:0@lo:400:kworker.0 00000100:00100000:0.0:1790740442.420175:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:0.0:1790740442.420181:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f0dbda75180, transno 4294967322 00000004:00080000:0.0:1790740442.420197:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:0.0:1790740442.420221:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0c86431880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158288896:0@lo:400:kworker.0 00000100:00080000:0.0:1790740442.421018:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790740442.421025:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790740442.421028:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1790740442.424302:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740442.934353:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d901dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158289024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790740442.934743:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740442.934947:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158289024 00000100:00100000:3.0:1790740442.934958:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158289024 00000100:00100000:3.0:1790740442.935146:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790740442.935158:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d901dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158289024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790740442.935209:0:6704:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790740442.935271:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d901dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158289024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740442.935280:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790740442.935368:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d901dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158289024:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1790740442.997236:0:5865:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:3.0:1790740442.997255:0:5865:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1790740442.997292:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1790740442.997305:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:0.0:1790740443.000012:0:11679:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790740443.000021:0:11679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790740443.000413:0:11679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:0.0:1790740443.000424:0:11679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790740443.023037:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740443.023077:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740443.023100:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740443.023128:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740443.023213:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740443.023258:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133141888 00000100:00100000:0.0:1790740443.023272:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133141888 00000100:00100000:0.0:1790740443.023342:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 302 00000100:00100000:0.0:1790740443.023355:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:2371:x1877727133141888:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:0.0:1790740443.023466:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:2371:x1877727133141888:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 114us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740443.023476:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 302 00000100:00100000:0.0:1790740443.023517:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133142016 00000100:00100000:0.0:1790740443.023521:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133142016 00000100:00100000:0.0:1790740443.023558:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133142400 00000100:00100000:0.0:1790740443.023560:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133142400 00000100:00100000:0.0:1790740443.023603:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 166 00000100:00100000:0.0:1790740443.023610:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0c86431880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+18:2371:x1877727133142016:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:0.0:1790740443.023647:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0c86431880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec599375-3198-45fd-a23a-c5620f07177c+18:2371:x1877727133142016:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 39us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740443.023654:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 166 00000100:00100000:0.0:1790740443.023664:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 167 00000100:00100000:0.0:1790740443.023669:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0c86433100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+5:2371:x1877727133142400:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:0.0:1790740443.023687:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0c86433100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+5:2371:x1877727133142400:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 18us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740443.023693:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 167 00000100:00100000:0.0:1790740443.023709:0:12467:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133142272 00000100:00100000:0.0:1790740443.023712:0:12467:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133142272 00000100:00100000:0.0:1790740443.023734:0:12467:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133142144 00000100:00100000:0.0:1790740443.023736:0:12467:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133142144 00000100:00100000:0.0:1790740443.023754:0:12467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 98 00000100:00100000:0.0:1790740443.023760:0:12467:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0c86433b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ec599375-3198-45fd-a23a-c5620f07177c+7:2372:x1877727133142272:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:0.0:1790740443.023795:0:12467:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0c86433b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ec599375-3198-45fd-a23a-c5620f07177c+7:2372:x1877727133142272:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 36us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740443.023802:0:12467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 98 00000100:00100000:0.0:1790740443.023812:0:12467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 99 00000100:00100000:0.0:1790740443.023818:0:12467:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0c86430e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ec599375-3198-45fd-a23a-c5620f07177c+5:2371:x1877727133142144:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:0.0:1790740443.023835:0:12467:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0c86430e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ec599375-3198-45fd-a23a-c5620f07177c+5:2371:x1877727133142144:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 17us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740443.023841:0:12467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 99 00000100:00080000:0.0:1790740443.023864:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790740443.023868:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790740443.023871:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790740443.443804:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790740443.443834:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d901dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158289152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790740443.443916:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740443.444001:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158289152 00000100:00100000:3.0:1790740443.444012:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158289152 00000100:00100000:3.0:1790740443.444070:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790740443.444080:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d901de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158289152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790740443.444122:0:6704:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790740443.444167:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d901de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158289152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740443.444174:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790740443.444240:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d901dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158289152:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790740443.448538:0:11661:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740444.466707:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740444.585977:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740444.586086:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133142528 00000100:00100000:0.0:1790740444.586097:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133142528 00000100:00100000:0.0:1790740444.586160:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 238 00000100:00100000:0.0:1790740444.586171:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d901dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+5:12303:x1877727133142528:12345-192.168.203.58@tcp:101:lsof.0 00010000:00010000:0.0:1790740444.586193:0:8666:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740444.586214:0:8666:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e000/0xc6b31a1b598eabde lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee7c6 expref: -99 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740444.586641:0:8666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fc00/0xc6b31a1b598eabe5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740444.586656:0:8666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fc00/0xc6b31a1b598eabe5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740444.586673:0:8666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fc00/0xc6b31a1b598eabe5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790740444.586796:0:8666:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790740444.586806:0:8666:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790740444.586872:0:8666:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fc00/0xc6b31a1b598eabe5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740444.586916:0:8666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e000/0xc6b31a1b598eabde lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee7c6 expref: 7 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740444.586943:0:8666:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fc00/0xc6b31a1b598eabe5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee7c6 expref: 6 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740444.586952:0:8666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0d98dcc200) 00010000:00010000:1.0:1790740444.586956:0:8666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790740444.586960:0:8666:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0dc132fc00, rc 0) 00000100:00100000:1.0:1790740444.587070:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d901dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+6:12303:x1877727133142528:12345-192.168.203.58@tcp:101:lsof.0 Request processed in 900us (1109us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740444.587081:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 238 00010000:00010000:2.0:1790740445.488942:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740445.913457:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740445.914398:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133142784 00000100:00100000:3.0:1790740445.914414:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133142784 00000100:00100000:3.0:1790740445.914520:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 66 00000100:00100000:3.0:1790740445.914535:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+18:12304:x1877727133142784:12345-192.168.203.58@tcp:35:umount.0 00000100:00080000:0.0:1790740445.914676:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790740445.916177:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+19:12304:x1877727133142784:12345-192.168.203.58@tcp:35:umount.0 Request processed in 1635us (2726us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1790740445.916191:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 66 00000100:00100000:0.0:1790740445.933834:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740445.933946:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133143040 00000100:00100000:1.0:1790740445.933968:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133143040 00000100:00100000:1.0:1790740445.934042:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 67 00000100:00100000:1.0:1790740445.934124:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0c86432300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec599375-3198-45fd-a23a-c5620f07177c+19:12304:x1877727133143040:12345-192.168.203.58@tcp:35:umount.0 00000100:00100000:1.0:1790740445.936198:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0c86432300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec599375-3198-45fd-a23a-c5620f07177c+20:12304:x1877727133143040:12345-192.168.203.58@tcp:35:umount.0 Request processed in 2129us (2484us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1790740445.936216:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 67 00000100:00100000:0.0:1790740445.943368:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740445.943454:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133143296 00000100:00100000:3.0:1790740445.943469:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133143296 00000100:00100000:3.0:1790740445.943550:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 68 00000100:00100000:3.0:1790740445.943623:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0da203a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+20:12304:x1877727133143296:12345-192.168.203.58@tcp:35:umount.0 00000100:00100000:3.0:1790740445.943935:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0da203a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+21:12304:x1877727133143296:12345-192.168.203.58@tcp:35:umount.0 Request processed in 316us (580us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1790740445.943944:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 68 00000100:00100000:2.0:1790740445.956039:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740445.966322:0:5846:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133143552 00000100:00100000:3.0:1790740445.966342:0:5846:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133143552 00000100:00100000:2.0:1790740445.970343:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 69 00000100:00100000:2.0:1790740445.970367:0:5846:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+21:12304:x1877727133143552:12345-192.168.203.58@tcp:35:umount.0 00000100:00100000:2.0:1790740445.971423:0:5846:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec599375-3198-45fd-a23a-c5620f07177c+22:12304:x1877727133143552:12345-192.168.203.58@tcp:35:umount.0 Request processed in 1055us (15390us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1790740445.971454:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 69 00000100:00100000:0.0:1790740445.983365:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740445.983460:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740445.988429:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133143680 00000100:00100000:1.0:1790740445.988452:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133143680 00000100:00100000:0.0:1790740445.988655:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740445.989149:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740445.989179:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133144320 00000100:00100000:0.0:1790740445.989185:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133144320 00000100:00100000:0.0:1790740445.989236:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 72 00000100:00100000:0.0:1790740445.989249:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d98511f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec599375-3198-45fd-a23a-c5620f07177c+7:2368:x1877727133144320:12345-192.168.203.58@tcp:9:umount.0 00000020:00000080:0.0:1790740445.989289:0:6699:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc6b31a1b598ea1ab 00000020:00010000:0.0:1790740445.989298:0:6699:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8f0dc110e800: total 0 00000100:00080000:0.0:1790740445.989303:0:6699:0:(import.c:65:import_set_state_nolock()) ffff8f0dc110c000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790740445.989351:0:6699:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1790740445.989715:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d98511f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec599375-3198-45fd-a23a-c5620f07177c+5:2368:x1877727133144320:12345-192.168.203.58@tcp:9:umount.0 Request processed in 468us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740445.989725:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 72 00000020:00010000:0.0:1790740445.989754:0:11661:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8f0dc110e800: total 0 00010000:00010000:0.0:1790740445.989775:0:11661:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8f0dc110e800, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1790740445.989854:0:11661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005859c61d/0xc6b31a1b598eabd7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee7bf expref: 4 pid: 12467 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740445.989897:0:11661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e292822a/0xc6b31a1b598ea547 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5f8 expref: 3 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740445.989939:0:11661:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8f0dc110e800, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1790740445.989951:0:11661:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740445.989953:0:11661:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740445.989955:0:11661:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790740445.989980:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790740445.990684:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133143936 00000100:00100000:2.0:1790740445.990694:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133143936 00000100:00100000:2.0:1790740445.990750:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133143808 00000100:00100000:2.0:1790740445.990754:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133143808 00000100:00100000:2.0:1790740445.990774:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 18 00000100:00100000:2.0:1790740445.990783:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0c86430380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+15:2369:x1877727133143680:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790740445.990800:0:5830:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740445.990815:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0dc21d3200/0xc6b31a1b598e9c6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee358 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740445.990832:0:5830:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790740445.990878:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0c86430380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+14:2369:x1877727133143680:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 96us (7529us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740445.990886:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 18 00000100:00100000:2.0:1790740445.990907:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 19 00000100:00100000:2.0:1790740445.990913:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0c86432300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+13:2369:x1877727133143936:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790740445.990921:0:5830:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740445.990930:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0d87595000/0xc6b31a1b598e9e55 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee423 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740445.990940:0:5830:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790740445.990969:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0c86432300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+12:2369:x1877727133143936:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 45us (7498us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740445.990976:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 19 00000100:00100000:2.0:1790740445.990990:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 20 00000100:00100000:2.0:1790740445.991009:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d87f2e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+11:2369:x1877727133143808:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790740445.991018:0:5830:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740445.991026:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0d9f977400/0xc6b31a1b598e9bd1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee320 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740445.991045:0:5830:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790740445.991064:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d87f2e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+10:2369:x1877727133143808:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 55us (2417us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740445.991263:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 20 00000100:00100000:0.0:1790740445.996213:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740445.996300:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133144448 00000100:00100000:2.0:1790740445.996313:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133144448 00000100:00100000:2.0:1790740445.996443:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 73 00000100:00100000:2.0:1790740445.996457:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1b43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec599375-3198-45fd-a23a-c5620f07177c+5:2368:x1877727133144448:12345-192.168.203.58@tcp:9:umount.0 00000020:00000080:2.0:1790740445.996510:0:6700:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc6b31a1b598e9f43 00000100:00080000:2.0:1790740445.996523:0:6700:0:(import.c:65:import_set_state_nolock()) ffff8f0d981ae000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790740445.996688:0:6700:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1790740445.997057:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1b43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec599375-3198-45fd-a23a-c5620f07177c+2:2368:x1877727133144448:12345-192.168.203.58@tcp:9:umount.0 Request processed in 603us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740445.997068:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 73 00000100:00080000:0.0:1790740445.997203:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790740445.997496:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740446.004270:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740446.004389:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133145472 00000100:00100000:0.0:1790740446.004403:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133145472 00000100:00100000:0.0:1790740446.004524:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 239 00000100:00100000:0.0:1790740446.004545:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+22:2368:x1877727133145472:12345-192.168.203.58@tcp:39:umount.0 00000020:00000080:0.0:1790740446.005060:0:5842:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc6b31a1b598e9bdf 00000020:00010000:0.0:1790740446.005093:0:5842:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8f0db6f4f800: total 0 00000100:00080000:0.0:1790740446.005099:0:5842:0:(import.c:65:import_set_state_nolock()) ffff8f0dc1a87000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790740446.005129:0:5842:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:0.0:1790740446.005785:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec599375-3198-45fd-a23a-c5620f07177c+21:2368:x1877727133145472:12345-192.168.203.58@tcp:39:umount.0 Request processed in 1240us (1525us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1790740446.005798:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 239 00000020:00010000:1.0:1790740446.006931:0:5831:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8f0db6f4f800: total 0 00010000:00010000:1.0:1790740446.007036:0:5831:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8f0db6f4f800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1790740446.007094:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f0d84a1ef00) 00010000:00010000:1.0:1790740446.007099:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790740446.007112:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598ea508 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5e3 expref: 20 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740446.007140:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f0d84a1ef00) 00010000:00010000:1.0:1790740446.007143:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1790740446.007147:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ea00/0xc6b31a1b598ea532 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5f1 expref: 19 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740446.007162:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f0d98dcc000) 00010000:00010000:1.0:1790740446.007164:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790740446.007168:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594a00/0xc6b31a1b598eaab8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee772 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740446.007204:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f0d98dccd00) 00010000:00010000:1.0:1790740446.007207:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1790740446.007212:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595200/0xc6b31a1b598ea5b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee614 expref: 17 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740446.007226:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0d98dcc200) 00010000:00010000:1.0:1790740446.007229:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790740446.007233:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87594600/0xc6b31a1b598ea59b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee60d expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740446.007248:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f0d98dccb00) 00010000:00010000:1.0:1790740446.007250:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790740446.007254:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6800/0xc6b31a1b598ea206 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee51f expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740446.007269:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8f0d84a1e500) 00010000:00010000:1.0:1790740446.007271:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790740446.007275:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976a00/0xc6b31a1b598e9ea9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee431 expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740446.007303:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f0d98dccb00) 00010000:00010000:1.0:1790740446.007306:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1790740446.007310:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d87595a00/0xc6b31a1b598e9f19 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee44d expref: 13 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740446.007327:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f0d98dcc000) 00010000:00010000:1.0:1790740446.007330:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1790740446.007341:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598eabc2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee7b8 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740446.007360:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f0d84a1ef00) 00010000:00010000:1.0:1790740446.007362:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790740446.007366:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f000/0xc6b31a1b598ea428 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee5ab expref: 11 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740446.007398:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f0d98dcc000) 00010000:00010000:1.0:1790740446.007400:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790740446.007405:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f600/0xc6b31a1b598eab98 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee7aa expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740446.007424:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f0d944f6600) 00010000:00010000:1.0:1790740446.007426:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740446.007430:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0e400/0xc6b31a1b598e9ec5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee438 expref: 9 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740446.007445:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f0d98dccd00) 00010000:00010000:1.0:1790740446.007448:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790740446.007452:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d80031200/0xc6b31a1b598ea896 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee6e6 expref: 8 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740446.007467:0:5831:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8f0db6f4f800, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1790740446.007764:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740446.007768:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740446.007770:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740446.512858:0:11661:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740447.536866:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740447.537129:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790740447.539087:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790740447.539121:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877727158289408:0@lo:400:kworker.0 00000100:00100000:1.0:1790740447.542222:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d901df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3306:1877727158289280:0@lo:400:kworker.0 00000100:00100000:3.0:1790740447.545199:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db57ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158289664:0@lo:400:kworker.0 00000100:00100000:2.0:1790740447.545226:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db57a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1877727158289536:0@lo:400:kworker.0 00000100:00100000:3.0:1790740447.545290:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740447.545291:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740447.547849:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740447.548159:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158289664 00000100:00100000:3.0:1790740447.548169:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158289664 00000100:00100000:2.0:1790740447.548213:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158289536 00000100:00100000:2.0:1790740447.548219:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158289536 00000100:00100000:3.0:1790740447.548273:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1790740447.548280:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158289280 00000100:00100000:3.0:1790740447.548287:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db57ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158289664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740447.548287:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1790740447.548288:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158289280 00000100:00100000:2.0:1790740447.548300:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1877727158289536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740447.548318:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1790740447.548325:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3306:x1877727158289280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740447.548359:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db57ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158289664:12345-0@lo:400:kworker.0 Request processed in 77us (3072us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740447.548367:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1790740447.548372:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1877727158289536:12345-0@lo:400:kworker.0 Request processed in 74us (3082us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740447.548379:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1790740447.548421:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db57ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158289664:0@lo:400:kworker.0 00000100:00100000:2.0:1790740447.548421:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db57a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1877727158289536:0@lo:400:kworker.0 00000100:00080000:2.0:1790740447.548467:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790740447.548471:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790740447.549494:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3306:x1877727158289280:12345-0@lo:400:kworker.0 Request processed in 1168us (1649us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740447.549502:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1790740447.549550:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d901df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3306:1877727158289280:0@lo:400:kworker.0 00000100:00100000:1.0:1790740447.549569:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db57aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158289920:0@lo:400:kworker.0 00000100:00100000:1.0:1790740447.549617:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740447.549641:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790740447.549648:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db57aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1877727158289792:0@lo:400:kworker.0 00000100:00100000:2.0:1790740447.549657:0:12467:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158289920 00000100:00100000:2.0:1790740447.549662:0:12467:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158289920 00000100:00100000:1.0:1790740447.549670:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740447.549696:0:12467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1790740447.549703:0:12467:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc12e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3306:x1877727158289920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740447.549818:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740447.549861:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158289792 00000100:00100000:0.0:1790740447.549866:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158289792 00000100:00100000:2.0:1790740447.549882:0:12467:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc12e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3306:x1877727158289920:12345-0@lo:400:kworker.0 Request processed in 179us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740447.549888:0:12467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1790740447.549895:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158289408 00000100:00100000:0.0:1790740447.549897:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158289408 00000100:00100000:0.0:1790740447.549915:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1790740447.549928:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1790740447.549932:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc12e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877727158289792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740447.549935:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1b40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877727158289408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740447.549983:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1b40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877727158289408:12345-0@lo:400:kworker.0 Request processed in 48us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740447.549989:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1790740447.550683:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db57aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158289920:0@lo:400:kworker.0 00000100:00100000:1.0:1790740447.550732:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877727158289408:0@lo:400:kworker.0 00000100:00100000:0.0:1790740447.551451:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc12e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877727158289792:12345-0@lo:400:kworker.0 Request processed in 1517us (1776us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740447.551461:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:3.0:1790740447.551660:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790740447.551666:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790740447.551681:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db57aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1877727158289792:0@lo:400:kworker.0 00000100:00100000:3.0:1790740447.713753:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740447.713799:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740447.713832:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740447.713867:0:8506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133145600 00000100:00100000:3.0:1790740447.713876:0:8506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133145600 00000100:00100000:2.0:1790740447.714014:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133145856 00000100:00100000:2.0:1790740447.714026:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133145856 00000100:00100000:0.0:1790740447.714052:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133145728 00000100:00100000:0.0:1790740447.714058:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133145728 00000100:00100000:2.0:1790740447.714071:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 21 00000100:00100000:2.0:1790740447.714083:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db57ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+12:2372:x1877727133145600:12345-192.168.203.58@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1790740447.714090:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 22 00000100:00100000:0.0:1790740447.714101:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db57abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+12:2372:x1877727133145856:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790740447.714115:0:5830:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740447.714115:0:5828:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740447.714138:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0d9fea6600/0xc6b31a1b598e9e4e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee41c expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740447.714139:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0d9fea7c00/0xc6b31a1b598e9cb1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee36d expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740447.714164:0:5828:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790740447.714180:0:5830:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740447.714226:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db57abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+10:2372:x1877727133145856:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 126us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740447.714234:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 22 00000100:00100000:0.0:1790740447.714254:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 23 00000100:00100000:0.0:1790740447.714261:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db57aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+9:2372:x1877727133145728:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790740447.714272:0:5828:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740447.714281:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0d9f977c00/0xc6b31a1b598e9cb8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee397 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740447.714295:0:5828:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790740447.714509:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db57ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+8:2372:x1877727133145600:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 428us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740447.714518:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 21 00000100:00100000:0.0:1790740447.717636:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db57aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+7:2372:x1877727133145728:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 3363us (3789us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740447.717650:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 23 00000100:00100000:3.0:1790740447.719891:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740447.721649:0:8666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133146112 00000100:00100000:2.0:1790740447.721662:0:8666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133146112 00000100:00100000:2.0:1790740447.721758:0:8666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 240 00000100:00100000:2.0:1790740447.721768:0:8666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db57a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+6:2368:x1877727133146112:12345-192.168.203.58@tcp:39:umount.0 00000020:00000080:2.0:1790740447.721809:0:8666:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc6b31a1b598e9cc6 00000020:00010000:2.0:1790740447.721817:0:8666:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8f0d83f22800: total 0 00000100:00080000:2.0:1790740447.721822:0:8666:0:(import.c:65:import_set_state_nolock()) ffff8f0d83f21000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790740447.721845:0:8666:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000020:00010000:1.0:1790740447.722115:0:5831:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8f0d83f22800: total 0 00010000:00010000:1.0:1790740447.722120:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740447.722172:0:5831:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8f0d83f22800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1790740447.722206:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0d98dcc200) 00010000:00010000:1.0:1790740447.722209:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790740447.722227:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132fc00/0xc6b31a1b598eabe5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee7c6 expref: 5 pid: 8666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740447.722271:0:5831:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8f0d83f22800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1790740447.722286:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740447.722288:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740447.722290:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740447.722744:0:8666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db57a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4b31cba-b68c-42cd-8636-ffe05cdf5b69+3:2368:x1877727133146112:12345-192.168.203.58@tcp:39:umount.0 Request processed in 976us (2860us total) trans 4294967527 rc 0/0 00000100:00100000:2.0:1790740447.722754:0:8666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 240 00000100:00080000:0.0:1790740447.726814:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790740447.738679:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740447.739143:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133146368 00000100:00100000:0.0:1790740447.739158:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133146368 00000100:00100000:0.0:1790740447.739237:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 304 00000100:00100000:0.0:1790740447.739248:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d83f10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+7:2368:x1877727133146368:12345-192.168.203.58@tcp:251:umount.0 00000020:00000080:0.0:1790740447.739300:0:5837:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc6b31a1b598e9bbc 00000020:00010000:0.0:1790740447.739308:0:5837:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8f0dc1f22800: total 0 00000100:00080000:0.0:1790740447.739314:0:5837:0:(import.c:65:import_set_state_nolock()) ffff8f0dc1f20800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1790740447.739722:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d83f10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad096e7-2e76-4f28-9317-dae6d3cb14fe+3:2368:x1877727133146368:12345-192.168.203.58@tcp:251:umount.0 Request processed in 474us (1055us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740447.739731:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 304 00000020:00010000:1.0:1790740447.750023:0:11661:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8f0dc1f22800: total 0 00010000:00010000:1.0:1790740447.750102:0:11661:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8f0dc1f22800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1790740447.750140:0:11661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0d9fea7600/0xc6b31a1b598e9c72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee35f expref: 2 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740447.750160:0:11661:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8f0dc1f22800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1790740447.750171:0:11661:0:(genops.c:885:class_export_put()) final put ffff8f0dc1f22800/7ad096e7-2e76-4f28-9317-dae6d3cb14fe 00010000:00010000:1.0:1790740447.750198:0:11661:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740447.750201:0:11661:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740447.750202:0:11661:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1790740447.750309:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f0dc1f22800/7ad096e7-2e76-4f28-9317-dae6d3cb14fe for MGS 00000020:00000080:0.0:1790740447.750363:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f0dc1f20800 for MGS 00000100:00100000:3.0:1790740448.053363:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790740448.053386:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158290048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790740448.053462:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740448.053539:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158290048 00000100:00100000:3.0:1790740448.053547:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158290048 00000100:00100000:3.0:1790740448.053619:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1790740448.053628:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db57a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158290048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790740448.053657:0:6704:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790740448.053700:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db57a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158290048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740448.053707:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1790740448.053760:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158290048:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1790740448.086248:0:12420:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ec599375-3198-45fd-a23a-c5620f07177c 00000001:00080000:1.0:1790740448.086257:0:5865:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000001:00080000:0.0:1790740448.086264:0:12420:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000001:00100000:1.0:1790740448.086269:0:5865:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e4b31cba-b68c-42cd-8636-ffe05cdf5b69 00000001:00080000:1.0:1790740448.086279:0:5865:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:1.0:1790740448.086283:0:5865:0:(genops.c:885:class_export_put()) final put ffff8f0d83f22800/e4b31cba-b68c-42cd-8636-ffe05cdf5b69 00000020:00000080:1.0:1790740448.086300:0:5865:0:(genops.c:885:class_export_put()) final put ffff8f0db6f4f800/ec599375-3198-45fd-a23a-c5620f07177c 00000020:00000080:1.0:1790740448.086318:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f0d83f22800/e4b31cba-b68c-42cd-8636-ffe05cdf5b69 for lustre-MDT0000 00000020:00000080:1.0:1790740448.086374:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f0db6f4f800/ec599375-3198-45fd-a23a-c5620f07177c for lustre-MDT0000 00000020:00000080:1.0:1790740448.086409:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f0d83f21000 for lustre-MDT0000 00000020:00000080:1.0:1790740448.086414:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f0dc1a87000 for lustre-MDT0000 00000001:00100000:1.0:1790740448.087813:0:7642:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ec599375-3198-45fd-a23a-c5620f07177c 00000020:00000080:1.0:1790740448.087820:0:7642:0:(genops.c:885:class_export_put()) final put ffff8f0dc110e800/ec599375-3198-45fd-a23a-c5620f07177c 00000020:00000080:0.0:1790740448.087874:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f0dc110e800/ec599375-3198-45fd-a23a-c5620f07177c for lustre-OST0001 00000020:00000080:0.0:1790740448.087914:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f0dc110c000 for lustre-OST0001 00000100:00100000:3.0:1790740448.560831:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db57a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158290176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790740448.560929:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740448.561044:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158290176 00000100:00100000:3.0:1790740448.561056:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158290176 00000100:00100000:3.0:1790740448.561115:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1790740448.561126:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db57a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158290176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790740448.561172:0:6704:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790740448.561228:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db57a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158290176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740448.561235:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1790740448.561298:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db57a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158290176:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790740448.562092:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1790740449.005282:0:12958:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1790740449.022775:0:12958:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1790740449.022823:0:12958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977600/0xc6b31a1b598e9c41 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9c48 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740449.022853:0:12958:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977600/0xc6b31a1b598e9c41 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598e9c48 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740449.022860:0:12958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977600/0xc6b31a1b598e9c41 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b31a1b598e9c48 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740449.022867:0:12958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977600/0xc6b31a1b598e9c41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b31a1b598e9c48 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740449.022884:0:12958:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1790740449.022889:0:12958:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1790740449.022913:0:12958:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790740449.022917:0:12958:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1790740449.022922:0:12958:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1790740449.022953:0:12958:0:(import.c:65:import_set_state_nolock()) ffff8f0db561d000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1790740449.023041:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790740449.023053:0:5831:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977600/0xc6b31a1b598e9c41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b31a1b598e9c48 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740449.023060:0:5831:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f977600 already unused, calling callback (ffffffffc1baec20) 10000000:00010000:1.0:1790740449.023063:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977600/0xc6b31a1b598e9c41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b31a1b598e9c48 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740449.023071:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977600/0xc6b31a1b598e9c41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xc6b31a1b598e9c48 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790740449.023078:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977600/0xc6b31a1b598e9c41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xc6b31a1b598e9c48 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790740449.023083:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1790740449.023085:0:5831:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1790740449.023087:0:5831:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1790740449.023108:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977600/0xc6b31a1b598e9c41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6b31a1b598e9c48 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740449.023123:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790740449.023149:0:5831:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977600/0xc6b31a1b598e9c41 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6b31a1b598e9c48 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740449.023156:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977600/0xc6b31a1b598e9c41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6b31a1b598e9c48 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740449.023169:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740449.023171:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740449.023172:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740449.023307:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790740449.023327:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3306:1877727158290432:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790740449.023402:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740449.024037:0:8506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158290432 00000100:00100000:1.0:1790740449.024045:0:8506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158290432 00000100:00100000:1.0:1790740449.024092:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790740449.024105:0:8506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db57a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3306:x1877727158290432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790740449.024124:0:8506:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740449.024137:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0d9fea7200/0xc6b31a1b598e9c48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc6b31a1b598e9c41 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740449.024147:0:8506:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740449.024187:0:8506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db57a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10ce3df1-3f26-4bb4-b4c3-d740981d121e+18:3306:x1877727158290432:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740449.024194:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790740449.024305:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3306:1877727158290432:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790740449.024365:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db57a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877727158290304:0@lo:39:umount.0 00000100:00100000:2.0:1790740449.024415:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740449.025216:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158290304 00000100:00100000:1.0:1790740449.025222:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158290304 00000100:00100000:1.0:1790740449.025258:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1790740449.025267:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877727158290304:12345-0@lo:39:umount.0 00000020:00000080:1.0:1790740449.025293:0:5844:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc6b31a1b598e99cb 00000100:00080000:1.0:1790740449.025301:0:5844:0:(import.c:65:import_set_state_nolock()) ffff8f0d874c2000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1790740449.025362:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3302:x1877727158290304:12345-0@lo:39:umount.0 Request processed in 97us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740449.025368:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000020:00000080:1.0:1790740449.025375:0:5844:0:(genops.c:885:class_export_put()) final put ffff8f0d874c3000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1790740449.025406:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f0d874c3000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1790740449.025446:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f0d874c2000 for lustre-MDT0000 00000100:00080000:1.0:1790740449.025482:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8f0db561d000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1790740449.025491:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db57a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877727158290304:0@lo:39:umount.0 00000100:00080000:3.0:1790740449.025552:0:12958:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790740449.025556:0:12958:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1790740449.025561:0:12958:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1790740449.027137:0:11661:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740449.027398:0:12958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3000/0xc6b31a1b598e9c4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9c56 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740449.027416:0:12958:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3000/0xc6b31a1b598e9c4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598e9c56 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740449.027438:0:12958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3000/0xc6b31a1b598e9c4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b31a1b598e9c56 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740449.027446:0:12958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3000/0xc6b31a1b598e9c4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b31a1b598e9c56 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740449.027847:0:12958:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790740449.027856:0:12958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976400/0xc6b31a1b598e9b76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9b7d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740449.027862:0:12958:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976400/0xc6b31a1b598e9b76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598e9b7d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740449.028492:0:12958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976400/0xc6b31a1b598e9b76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b31a1b598e9b7d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740449.028499:0:12958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976400/0xc6b31a1b598e9b76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b31a1b598e9b7d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740449.028537:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790740449.028543:0:5832:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3000/0xc6b31a1b598e9c4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b31a1b598e9c56 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740449.028551:0:5832:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc21d3000 already unused, calling callback (ffffffffc1baec20) 10000000:00010000:2.0:1790740449.028555:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3000/0xc6b31a1b598e9c4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b31a1b598e9c56 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740449.028604:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3000/0xc6b31a1b598e9c4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xc6b31a1b598e9c56 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790740449.028612:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3000/0xc6b31a1b598e9c4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xc6b31a1b598e9c56 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790740449.028618:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790740449.028620:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1790740449.028656:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3000/0xc6b31a1b598e9c4f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6b31a1b598e9c56 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740449.028663:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790740449.028701:0:5832:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3000/0xc6b31a1b598e9c4f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6b31a1b598e9c56 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740449.028707:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d3000/0xc6b31a1b598e9c4f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6b31a1b598e9c56 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740449.028719:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790740449.028722:0:5832:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976400/0xc6b31a1b598e9b76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b31a1b598e9b7d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740449.028727:0:5832:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f976400 already unused, calling callback (ffffffffc1baec20) 10000000:00010000:2.0:1790740449.028729:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976400/0xc6b31a1b598e9b76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b31a1b598e9b7d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740449.028734:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976400/0xc6b31a1b598e9b76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc6b31a1b598e9b7d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790740449.028739:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976400/0xc6b31a1b598e9b76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc6b31a1b598e9b7d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790740449.028754:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1790740449.028756:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:2.0:1790740449.028769:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976400/0xc6b31a1b598e9b76 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6b31a1b598e9b7d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740449.028774:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790740449.028788:0:5832:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976400/0xc6b31a1b598e9b76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6b31a1b598e9b7d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740449.028794:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740449.028796:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740449.028798:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740449.028861:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbee6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3306:1877727158290560:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790740449.028921:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740449.029003:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd7d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3303:1877727158290688:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790740449.029025:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740449.029306:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158290560 00000100:00100000:2.0:1790740449.029314:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158290560 00000100:00100000:3.0:1790740449.029511:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158290688 00000100:00100000:3.0:1790740449.029516:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158290688 00000100:00100000:3.0:1790740449.029634:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790740449.029644:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db57ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+19:3303:x1877727158290688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790740449.029655:0:5828:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740449.029668:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0d9fea7000/0xc6b31a1b598e9b7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc6b31a1b598e9b76 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740449.029695:0:5828:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790740449.029734:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db57ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+18:3303:x1877727158290688:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740449.029741:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790740449.029761:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790740449.029767:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db57a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+17:3306:x1877727158290560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790740449.029775:0:5828:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740449.029782:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0d9fea7800/0xc6b31a1b598e9c56 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc6b31a1b598e9c4f expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740449.029805:0:5828:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790740449.029832:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db57a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10ce3df1-3f26-4bb4-b4c3-d740981d121e+16:3306:x1877727158290560:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740449.029837:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790740449.030016:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbee6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3306:1877727158290560:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790740449.030053:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd7d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3303:1877727158290688:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790740449.030806:0:12958:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1790740449.030814:0:12958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976400/0xc6b31a1b598e9b76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6b31a1b598e9b7d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790740449.030834:0:12958:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1790740449.030844:0:12958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7400/0xc6b31a1b598e9e78 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9e7f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740449.030853:0:12958:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7400/0xc6b31a1b598e9e78 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598e9e7f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740449.030872:0:12958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7400/0xc6b31a1b598e9e78 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b31a1b598e9e7f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740449.030878:0:12958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7400/0xc6b31a1b598e9e78 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b31a1b598e9e7f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740449.030931:0:12958:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790740449.030949:0:12958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976e00/0xc6b31a1b598e992a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9931 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740449.030956:0:12958:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976e00/0xc6b31a1b598e992a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598e9931 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740449.030963:0:12958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976e00/0xc6b31a1b598e992a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b31a1b598e9931 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740449.030969:0:12958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976e00/0xc6b31a1b598e992a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b31a1b598e9931 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740449.031021:0:11661:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790740449.031027:0:11661:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7400/0xc6b31a1b598e9e78 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b31a1b598e9e7f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740449.031067:0:11661:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9fea7400 already unused, calling callback (ffffffffc1baec20) 10000000:00010000:3.0:1790740449.031071:0:11661:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7400/0xc6b31a1b598e9e78 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b31a1b598e9e7f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740449.031079:0:11661:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7400/0xc6b31a1b598e9e78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc6b31a1b598e9e7f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790740449.031086:0:11661:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7400/0xc6b31a1b598e9e78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc6b31a1b598e9e7f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740449.031092:0:11661:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1790740449.031094:0:11661:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1790740449.031096:0:11661:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1790740449.031122:0:11661:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7400/0xc6b31a1b598e9e78 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6b31a1b598e9e7f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740449.031128:0:11661:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790740449.031159:0:11661:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7400/0xc6b31a1b598e9e78 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6b31a1b598e9e7f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740449.031167:0:11661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7400/0xc6b31a1b598e9e78 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6b31a1b598e9e7f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740449.031177:0:11661:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740449.031188:0:11661:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976e00/0xc6b31a1b598e992a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b31a1b598e9931 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740449.031199:0:11661:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f976e00 already unused, calling callback (ffffffffc1baec20) 10000000:00010000:3.0:1790740449.031201:0:11661:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976e00/0xc6b31a1b598e992a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b31a1b598e9931 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740449.031215:0:11661:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976e00/0xc6b31a1b598e992a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc6b31a1b598e9931 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790740449.031220:0:11661:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976e00/0xc6b31a1b598e992a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc6b31a1b598e9931 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740449.031225:0:11661:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1790740449.031227:0:11661:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:3.0:1790740449.031240:0:11661:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976e00/0xc6b31a1b598e992a lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6b31a1b598e9931 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740449.031245:0:11661:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790740449.031258:0:11661:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976e00/0xc6b31a1b598e992a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6b31a1b598e9931 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740449.031266:0:11661:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740449.031268:0:11661:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740449.031269:0:11661:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740449.031284:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db57a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3305:1877727158290944:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790740449.031329:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740449.031389:0:8506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158290944 00000100:00100000:3.0:1790740449.031395:0:8506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158290944 00000100:00100000:3.0:1790740449.031429:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790740449.031435:0:8506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d87f2e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10ce3df1-3f26-4bb4-b4c3-d740981d121e+16:3305:x1877727158290944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790740449.031444:0:8506:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740449.031455:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0d9fea6000/0xc6b31a1b598e9931 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc6b31a1b598e992a expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740449.031467:0:8506:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790740449.031503:0:8506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d87f2e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10ce3df1-3f26-4bb4-b4c3-d740981d121e+15:3305:x1877727158290944:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740449.031510:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790740449.031554:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790740449.031563:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db57a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3303:1877727158290816:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790740449.031609:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740449.031649:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158290816 00000100:00100000:3.0:1790740449.031653:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158290816 00000100:00100000:3.0:1790740449.031686:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790740449.031693:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db57abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+15:3303:x1877727158290816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790740449.031700:0:5829:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740449.031710:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0d9f976800/0xc6b31a1b598e9e7f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc6b31a1b598e9e78 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740449.031721:0:5829:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790740449.031747:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db57abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10ce3df1-3f26-4bb4-b4c3-d740981d121e+14:3303:x1877727158290816:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740449.031752:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790740449.031780:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db57a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3305:1877727158290944:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790740449.031801:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db57a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3303:1877727158290816:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790740449.032273:0:12958:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1790740449.032280:0:12958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976e00/0xc6b31a1b598e992a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6b31a1b598e9931 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790740449.032292:0:12958:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:1.0:1790740449.032297:0:12958:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1790740449.032299:0:12958:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1790740449.032326:0:12958:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1790740449.032329:0:12958:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00010000:00010000:3.0:1790740449.032399:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740449.032441:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1790740449.032468:0:12958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790740449.032480:0:12958:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1790740449.032485:0:12958:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8f0dc1a87800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790740449.032491:0:12958:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8f0db7a37000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790740449.032495:0:12958:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff8f0d84900000) has exports, disconnecting them 00000020:00080000:1.0:1790740449.032499:0:12958:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8f0dc1a87800), last request at 1790740447 00000020:00000080:1.0:1790740449.032505:0:12958:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc6b31a1b598e9b3e 00000100:00080000:1.0:1790740449.032520:0:12958:0:(import.c:65:import_set_state_nolock()) ffff8f0dc1a86000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1790740449.032652:0:11661:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1790740449.032741:0:12958:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f0dc1a87800): rc 0 00000020:00000080:1.0:1790740449.032744:0:12958:0:(genops.c:885:class_export_put()) final put ffff8f0dc1a87800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1790740449.032759:0:12958:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8f0db7a37000), last request at 1790740447 00000020:00000080:1.0:1790740449.032763:0:12958:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc6b31a1b598e9a65 00000100:00080000:1.0:1790740449.032769:0:12958:0:(import.c:65:import_set_state_nolock()) ffff8f0db7a31800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1790740449.032783:0:12958:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f0db7a37000): rc 0 00000020:00000080:1.0:1790740449.032785:0:12958:0:(genops.c:885:class_export_put()) final put ffff8f0db7a37000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1790740449.032793:0:12958:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa28880da3ae0 00000100:00080000:1.0:1790740449.032812:0:12958:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1790740449.032815:0:12958:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:1.0:1790740449.032826:0:12958:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1790740449.032885:0:12958:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1790740449.032903:0:12958:0:(import.c:65:import_set_state_nolock()) ffff8f0db7a36000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1790740449.032918:0:12958:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1790740449.032921:0:12958:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:1.0:1790740449.032928:0:12958:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1790740449.033005:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1877727158291072:0@lo:9:umount.0 00000100:00100000:1.0:1790740449.033059:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740449.033103:0:6700:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158291072 00000100:00100000:1.0:1790740449.033108:0:6700:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158291072 00000100:00100000:1.0:1790740449.033146:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790740449.033161:0:6700:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d901df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1877727158291072:12345-0@lo:9:umount.0 00000020:00000080:1.0:1790740449.033197:0:6700:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc6b31a1b598e9ab2 00000100:00080000:1.0:1790740449.033204:0:6700:0:(import.c:65:import_set_state_nolock()) ffff8f0db7a34800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790740449.033237:0:6700:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1790740449.033408:0:6700:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d901df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3302:x1877727158291072:12345-0@lo:9:umount.0 Request processed in 248us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740449.033416:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00010000:1.0:1790740449.033430:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790740449.033448:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8f0db7a36000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1790740449.033452:0:3302:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1790740449.033453:0:3302:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1790740449.033456:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1877727158291072:0@lo:9:umount.0 00000100:00080000:1.0:1790740449.033469:0:12958:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1790740449.033478:0:12958:0:(import.c:65:import_set_state_nolock()) ffff8f0db5717000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1790740449.033491:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1877727158291200:0@lo:9:umount.0 00000100:00100000:1.0:1790740449.033511:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740449.033534:0:6699:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158291200 00000100:00100000:1.0:1790740449.033538:0:6699:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158291200 00000100:00100000:1.0:1790740449.033559:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790740449.033565:0:6699:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1877727158291200:12345-0@lo:9:umount.0 00000020:00000080:1.0:1790740449.033598:0:6699:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc6b31a1b598e9bb5 00000100:00080000:1.0:1790740449.033603:0:6699:0:(import.c:65:import_set_state_nolock()) ffff8f0dc1a86800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790740449.033619:0:6699:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1790740449.033842:0:6699:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3302:x1877727158291200:12345-0@lo:9:umount.0 Request processed in 276us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740449.033848:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1790740449.033871:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8f0db5717000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1790740449.033884:0:3302:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1790740449.033886:0:3302:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1790740449.033889:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1877727158291200:0@lo:9:umount.0 00000020:00080000:1.0:1790740449.033926:0:12958:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8f0d84900000) has no exports 00000020:00000080:2.0:1790740449.034429:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f0dc1a87800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1790740449.034479:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f0db7a37000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1790740449.034505:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f0dc1a86000 for lustre-MDT0000 00000020:00000080:2.0:1790740449.034509:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f0db7a31800 for lustre-MDT0000 00010000:00010000:3.0:1790740449.034637:0:11661:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740449.034642:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790740449.034873:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790740449.034878:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:2.0:1790740449.042155:0:12958:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8f0d84900000) has no exports 00000020:00000080:2.0:1790740449.073007:0:12958:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc6b31a1b598e9985 00000020:00000080:2.0:1790740449.073024:0:12958:0:(genops.c:885:class_export_put()) final put ffff8f0da2083800/lustre-QMT0000_UUID 00000020:01000000:2.0:1790740449.073083:0:12958:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1790740449.073122:0:12958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790740449.073133:0:12958:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1790740449.073137:0:12958:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff8f0dbeb48000) has no exports 00000020:00000080:1.0:1790740449.073149:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f0da2083800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1790740449.073877:0:12958:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc6b31a1b598e997e 00000020:00000080:1.0:1790740449.073882:0:12958:0:(genops.c:885:class_export_put()) final put ffff8f0dbeb5b000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1790740449.073894:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f0dbeb5b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1790740449.073931:0:12958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790740449.073950:0:12958:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1790740449.073953:0:12958:0:(genops.c:885:class_export_put()) final put ffff8f0db5614800/lustre-QMT0000_UUID 00000020:00000080:1.0:1790740449.073955:0:12958:0:(genops.c:844:class_export_destroy()) destroying export ffff8f0db5614800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1790740449.073962:0:12958:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:1.0:1790740449.074073:0:12958:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff8f0db1da3480 - data ffff8f0da801fe58/ffff8f0db6c21800 00000020:01000000:1.0:1790740449.074197:0:12958:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff8f0d87f1e180 - data ffff8f0da28fb438/ffff8f0dbeb9bc00 00000001:00000004:2.0:1790740449.093817:0:12958:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000001:00100000:3.0:1790740449.112108:0:6725:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1790740449.112118:0:6725:0:(genops.c:885:class_export_put()) final put ffff8f0db7a30800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790740449.112200:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f0db7a30800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1790740449.112250:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f0db7a34800 for lustre-OST0000 00000001:00100000:3.0:1790740449.113212:0:6725:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ec599375-3198-45fd-a23a-c5620f07177c 00000020:00000080:3.0:1790740449.113226:0:6725:0:(genops.c:885:class_export_put()) final put ffff8f0d981af800/ec599375-3198-45fd-a23a-c5620f07177c 00000020:00000080:2.0:1790740449.113325:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f0d981af800/ec599375-3198-45fd-a23a-c5620f07177c for lustre-OST0000 00000020:00000080:2.0:1790740449.113442:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f0d981ae000 for lustre-OST0000 00000100:00080000:2.0:1790740449.159643:0:12958:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1790740449.159651:0:12958:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1790740449.159676:0:12958:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790740449.159689:0:12958:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1790740449.160767:0:6813:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1790740449.160773:0:6813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:1.0:1790740449.160787:0:6813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1790740449.162265:0:12958:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1790740449.162272:0:12958:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:0.0:1790740449.162293:0:12958:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1790740449.162296:0:12958:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1790740449.163609:0:8151:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1790740449.163615:0:8151:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:1.0:1790740449.163627:0:8151:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1790740449.215010:0:12958:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc6b31a1b598e994d 00000020:00000080:0.0:1790740449.215023:0:12958:0:(genops.c:885:class_export_put()) final put ffff8f0db9a60800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1790740449.215302:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f0db9a60800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1790740449.216486:0:12958:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc6b31a1b598e9962 00000020:00000080:0.0:1790740449.216506:0:12958:0:(genops.c:885:class_export_put()) final put ffff8f0db5a7e800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1790740449.216567:0:12958:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1790740449.216599:0:12958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790740449.216608:0:12958:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1790740449.216612:0:12958:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff8f0d84903380) has no exports 00000004:01000000:0.0:1790740449.216852:0:12958:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1790740449.216860:0:12958:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc6b31a1b598e9ba0 00000020:00000080:0.0:1790740449.216864:0:12958:0:(genops.c:885:class_export_put()) final put ffff8f0db562e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1790740449.216925:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f0db5a7e800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1790740449.216990:0:12958:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1790740449.216995:0:12958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790740449.217002:0:12958:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1790740449.217004:0:12958:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff8f0db6f58000) has no exports 00000020:00000080:0.0:1790740449.217010:0:12958:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc6b31a1b598e9b99 00000020:00000080:0.0:1790740449.217014:0:12958:0:(genops.c:885:class_export_put()) final put ffff8f0db5628000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1790740449.217031:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f0db562e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:0.0:1790740449.218415:0:12958:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1790740449.218424:0:12958:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1790740449.218428:0:12958:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:0.0:1790740449.218435:0:12958:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1790740449.218437:0:12958:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1790740449.218566:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f0db5628000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1790740449.218684:0:12958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790740449.218694:0:12958:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790740449.218703:0:12958:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc6b31a1b598e9aab 00000020:00000080:0.0:1790740449.218709:0:12958:0:(genops.c:885:class_export_put()) final put ffff8f0db6f4a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1790740449.218732:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f0db5717000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1790740449.218737:0:8:0:(genops.c:885:class_export_put()) final put ffff8f0db6c1a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1790740449.218739:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f0db6c1a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1790740449.218743:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1790740449.218867:0:12958:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1790740449.218872:0:12958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790740449.218877:0:12958:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1790740449.218880:0:12958:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff8f0dbeb4b380) has no exports 00000020:00000080:0.0:1790740449.218885:0:12958:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc6b31a1b598e9aa4 00000020:00000080:0.0:1790740449.218889:0:12958:0:(genops.c:885:class_export_put()) final put ffff8f0db7a37800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1790740449.218908:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f0db6f4a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:0.0:1790740449.219625:0:12958:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1790740449.219630:0:12958:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1790740449.219633:0:12958:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1790740449.219647:0:12958:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1790740449.219649:0:12958:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1790740449.219763:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f0db7a37800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1790740449.219932:0:12958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790740449.219949:0:12958:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790740449.219989:0:12958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790740449.219993:0:12958:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790740449.219996:0:12958:0:(genops.c:885:class_export_put()) final put ffff8f0db9a64000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790740449.219999:0:12958:0:(genops.c:844:class_export_destroy()) destroying export ffff8f0db9a64000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1790740449.220004:0:12958:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790740449.220181:0:12958:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc6b31a1b598e9969 00000020:00000080:0.0:1790740449.220186:0:12958:0:(genops.c:885:class_export_put()) final put ffff8f0db5a7e000/lustre-MDD0000_UUID 00000020:00000080:2.0:1790740449.220626:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f0db7a36000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1790740449.220635:0:8:0:(genops.c:885:class_export_put()) final put ffff8f0db7a33800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1790740449.220637:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f0db7a33800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1790740449.220645:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1790740449.220798:0:12958:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1790740449.220803:0:12958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790740449.220809:0:12958:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1790740449.220812:0:12958:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff8f0db5a73380) has no exports 00000020:00000080:0.0:1790740449.220832:0:12958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790740449.220834:0:12958:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1790740449.220839:0:12958:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc6b31a1b598e9970 00000020:00000080:0.0:1790740449.220843:0:12958:0:(genops.c:885:class_export_put()) final put ffff8f0db5a7f800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1790740449.220852:0:12958:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f0d85311800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1790740449.220855:0:12958:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f0d85311800 3 00000020:01000004:0.0:1790740449.220858:0:12958:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8f0d85311800 from lustre-MDT0000 00000020:00000080:0.0:1790740449.220871:0:12958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790740449.220873:0:12958:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1790740449.220875:0:12958:0:(genops.c:885:class_export_put()) final put ffff8f0db9a63000/lustre-MDT0000_UUID 00000020:00000080:0.0:1790740449.220877:0:12958:0:(genops.c:844:class_export_destroy()) destroying export ffff8f0db9a63000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1790740449.220884:0:12958:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1790740449.220911:0:12958:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1790740449.220914:0:12958:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1790740449.220917:0:12958:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1790740449.220919:0:12958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790740449.220921:0:12958:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1790740449.220927:0:12958:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff8f0d864f8000 10ce3df1-3f26-4bb4-b4c3-d740981d121e 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790740449.220949:0:12958:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff8f0d849019c0) has exports, disconnecting them 00000020:00080000:0.0:1790740449.220953:0:12958:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8f0d864f8000), last request at 1790740229 00000020:00000080:0.0:1790740449.220967:0:12958:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc6b31a1b598e9907 00000020:00010000:0.0:1790740449.220971:0:12958:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8f0d864f8000: total 2 00000100:00080000:0.0:1790740449.220975:0:12958:0:(import.c:65:import_set_state_nolock()) ffff8f0d864ff800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1790740449.220993:0:12958:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f0d864f8000): rc 0 00000020:00080000:0.0:1790740449.220999:0:12958:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff8f0d849019c0) has no exports 00000020:00010000:1.0:1790740449.221015:0:5831:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8f0d864f8000: total 2 00010000:00010000:1.0:1790740449.221043:0:5831:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8f0d864f8000, canceled 0 locks, left on hash table 8. 00000100:00100000:0.0:1790740449.221051:0:5835:0:(service.c:3206:ptlrpc_main()) ll_mgs_0000: service thread [ffff8f0d83f5fc00:5835] 0 exiting: rc = 1 00010000:00010000:1.0:1790740449.221068:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0d9fea6400/0xc6b31a1b598e9c10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc6b31a1b598e9c09 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740449.221084:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0dc21d2c00/0xc6b31a1b598e9c2c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc6b31a1b598e9c25 expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740449.221120:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0d9f498c00/0xc6b31a1b598e9c1e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc6b31a1b598e9c17 expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740449.221131:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0dc21d3e00/0xc6b31a1b598e9c3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc6b31a1b598e9c33 expref: 6 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740449.221142:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0d9f977200/0xc6b31a1b598e9a18 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc6b31a1b598e9a11 expref: 5 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740449.221158:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0d9f977a00/0xc6b31a1b598e9e71 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc6b31a1b598e9e6a expref: 4 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740449.221169:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0dc21d3400/0xc6b31a1b598e9c64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc6b31a1b598e9c5d expref: 3 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740449.221180:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0d87594c00/0xc6b31a1b598e9e63 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc6b31a1b598e9e5c expref: 2 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740449.221190:0:5831:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8f0d864f8000, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1790740449.221203:0:5831:0:(genops.c:885:class_export_put()) final put ffff8f0d864f8000/10ce3df1-3f26-4bb4-b4c3-d740981d121e 00010000:00010000:1.0:1790740449.221209:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740449.221211:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740449.221213:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740449.221237:0:5836:0:(service.c:3206:ptlrpc_main()) ll_mgs_0001: service thread [ffff8f0d848d6a00:5836] 1 exiting: rc = 0 00000100:00100000:0.0:1790740449.221420:0:5837:0:(service.c:3206:ptlrpc_main()) ll_mgs_0002: service thread [ffff8f0d83f5f400:5837] 2 exiting: rc = 0 00000020:00000080:2.0:1790740449.221466:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f0db5a7e000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1790740449.221470:0:8:0:(genops.c:885:class_export_put()) final put ffff8f0db9a62000/lustre-MDD0000_UUID 00000020:00000080:2.0:1790740449.221472:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f0db9a62000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1790740449.221476:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1790740449.221672:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f0db5a7f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1790740449.221677:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f0d864f8000/10ce3df1-3f26-4bb4-b4c3-d740981d121e for MGS 00000020:00000080:2.0:1790740449.221704:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f0d864ff800 for MGS 00000100:00100000:0.0:1790740449.221985:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.221993:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.221998:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.222004:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.222010:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.222016:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.222021:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.222027:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.222036:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.222041:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.222046:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.222051:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.222057:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.222062:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.222067:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.222072:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.222077:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.222082:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.222086:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.222092:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.222155:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.222389:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.222397:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.222403:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.222418:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.222423:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.222429:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.222434:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.222439:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.222445:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.222449:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.222454:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.222459:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.222463:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.222470:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.222474:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.222479:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.222483:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.222488:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.222493:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.222498:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.222502:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.222507:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.222511:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.222516:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.222521:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.222525:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.222530:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.222535:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.222539:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.222545:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.222550:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.222556:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.222562:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.222567:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.222595:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.222601:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.222607:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.222613:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.222625:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.222631:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.222637:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.222642:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.222647:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:0.0:1790740449.223010:0:12958:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1790740449.223013:0:12958:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:0.0:1790740449.223995:0:12958:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff8f0db1c23540 - data ffff8f0da2bb3ca8/ffff8f0c8554a800 00000020:01000000:0.0:1790740449.224104:0:12958:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff8f0d82fc5d80 - data ffff8f0dae742870/ffff8f0d88132c00 00000020:00000080:0.0:1790740449.225617:0:12958:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc6b31a1b598e98f2 00000020:00000080:0.0:1790740449.225628:0:12958:0:(genops.c:885:class_export_put()) final put ffff8f0db1fc8000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1790740449.225646:0:12958:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f0d85311800 from MGS, refs=2 00000020:01000004:0.0:1790740449.225649:0:12958:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f0d85311800 2 00000020:01000004:0.0:1790740449.225652:0:12958:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8f0d85311800 from MGS 00000020:00000080:0.0:1790740449.225673:0:12958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790740449.225680:0:12958:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1790740449.225683:0:12958:0:(genops.c:885:class_export_put()) final put ffff8f0db1fcd800/MGS 00000020:00000080:0.0:1790740449.225685:0:12958:0:(genops.c:844:class_export_destroy()) destroying export ffff8f0db1fcd800/MGS for MGS 00000020:01000000:0.0:1790740449.225693:0:12958:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1790740449.225751:0:12958:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1790740449.225755:0:12958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790740449.225761:0:12958:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1790740449.225767:0:12958:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8f0db561a800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790740449.225773:0:12958:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff8f0db6d78000) has exports, disconnecting them 00000020:00080000:0.0:1790740449.225777:0:12958:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8f0db561a800), last request at 1790740230 00000020:00000080:0.0:1790740449.225782:0:12958:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc6b31a1b598e99bd 00000020:00080000:0.0:1790740449.225796:0:12958:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f0db561a800): rc 0 00000020:00000080:0.0:1790740449.225801:0:12958:0:(genops.c:885:class_export_put()) final put ffff8f0db561a800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1790740449.226184:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f0db1fc8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1790740449.226436:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f0db561a800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1790740449.229308:0:12958:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1790740449.229317:0:12958:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790740449.229321:0:12958:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1790740449.229327:0:12958:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1790740449.229393:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f0db561d000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1790740449.229484:0:12958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790740449.229503:0:12958:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1790740449.229508:0:12958:0:(genops.c:885:class_export_put()) final put ffff8f0db5618000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1790740449.229512:0:12958:0:(genops.c:844:class_export_destroy()) destroying export ffff8f0db5618000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1790740449.229517:0:12958:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1790740449.229591:0:12958:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f0d85311800 1 00000020:00000080:1.0:1790740449.229597:0:12958:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc6b31a1b598e98e4 00000020:00000080:1.0:1790740449.229603:0:12958:0:(genops.c:885:class_export_put()) final put ffff8f0db1fc8800/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1790740449.229616:0:12958:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1790740449.229620:0:12958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790740449.229625:0:12958:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1790740449.229628:0:12958:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff8f0d87f40000) has no exports 00000020:00000080:2.0:1790740449.229639:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f0db1fc8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1790740449.254174:0:12958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790740449.254187:0:12958:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1790740449.254193:0:12958:0:(genops.c:885:class_export_put()) final put ffff8f0d85317800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1790740449.254197:0:12958:0:(genops.c:844:class_export_destroy()) destroying export ffff8f0d85317800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1790740449.254217:0:12958:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1790740449.254333:0:12958:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8f0d85314000 00000020:01000000:0.0:1790740449.254353:0:12958:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1790740449.254362:0:12958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790740449.254367:0:12958:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1790740449.254370:0:12958:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff8f0d84904d40) has no exports 00000100:00100000:2.0:1790740449.254498:0:8666:0:(service.c:3206:ptlrpc_main()) mdt00_003: service thread [ffff8f0d8653b600:8666] 3 exiting: rc = 0 00000100:00100000:3.0:1790740449.254643:0:5842:0:(service.c:3206:ptlrpc_main()) mdt00_000: service thread [ffff8f0d88136c00:5842] 0 exiting: rc = 1 00000100:00100000:3.0:1790740449.254751:0:5843:0:(service.c:3206:ptlrpc_main()) mdt00_001: service thread [ffff8f0d88137800:5843] 1 exiting: rc = 0 00000100:00100000:0.0:1790740449.256198:0:5844:0:(service.c:3206:ptlrpc_main()) mdt00_002: service thread [ffff8f0d88137c00:5844] 2 exiting: rc = 0 00000100:00100000:3.0:1790740449.256642:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740449.256651:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740449.256657:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740449.256663:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740449.256669:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740449.256676:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740449.256682:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740449.256688:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740449.256695:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740449.256700:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740449.256706:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740449.256711:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740449.256717:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740449.256723:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740449.256729:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740449.256735:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740449.256741:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740449.256749:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740449.256755:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740449.256761:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740449.256767:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740449.256772:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740449.256778:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740449.256784:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740449.256790:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740449.256795:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740449.256801:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740449.256807:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740449.256812:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740449.256817:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740449.256822:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740449.256842:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740449.256847:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740449.256853:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740449.256859:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740449.256864:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740449.256870:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740449.256876:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740449.256881:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740449.256887:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740449.256894:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740449.256899:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740449.256905:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740449.256910:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740449.256915:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740449.256921:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740449.256926:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740449.256931:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740449.256949:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740449.256955:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740449.256961:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740449.256969:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740449.256974:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740449.256979:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740449.256985:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740449.256990:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740449.256994:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740449.256999:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740449.257004:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740449.257009:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740449.257013:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740449.257018:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740449.257022:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740449.257027:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740449.262679:0:5845:0:(service.c:3206:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8f0d88136e00:5845] 0 exiting: rc = 1 00000100:00100000:0.0:1790740449.263034:0:5846:0:(service.c:3206:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8f0d88137e00:5846] 1 exiting: rc = 0 00000100:00100000:2.0:1790740449.263452:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.263474:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.263486:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.263495:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.263506:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.263517:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.263526:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.263536:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.263546:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.263557:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.263566:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.263615:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.263627:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.263636:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.263647:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.263657:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.263668:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.263676:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.263684:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.263695:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.263705:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.263721:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.263728:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.263734:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.263740:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.263744:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.263750:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.263754:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.263759:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.263764:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.263769:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.263775:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.263784:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.263793:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.263803:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.263892:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.263899:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.263906:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.263915:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.263925:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.263945:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.263954:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.263963:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.263972:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.263983:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.263993:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.264003:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.264012:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.264022:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.264031:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.264041:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.264050:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.264060:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.264069:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.264080:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.264089:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.264099:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.264109:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.264176:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.264185:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.264195:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.264204:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.264211:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.264216:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.264750:0:5848:0:(service.c:3206:ptlrpc_main()) mdt_out00_001: service thread [ffff8f0d880e7400:5848] 1 exiting: rc = 0 00000100:00100000:1.0:1790740449.264786:0:5847:0:(service.c:3206:ptlrpc_main()) mdt_out00_000: service thread [ffff8f0d8491c200:5847] 0 exiting: rc = 1 00000100:00100000:2.0:1790740449.264880:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.264889:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.264896:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.264901:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.264904:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.264909:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.264921:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.264925:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.264928:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.264932:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.264949:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.264962:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.264967:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.264971:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.264976:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.264980:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.264984:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.264987:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.264991:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.264995:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.264999:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.265002:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.265006:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.265019:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.265024:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.265027:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.265031:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.265035:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.265039:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.265043:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.265047:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.265050:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.265055:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.265058:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.265062:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.265075:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.265080:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.265084:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.265088:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.265093:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.265099:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.265167:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.265174:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.265178:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.265182:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.265185:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.265190:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.265206:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.265210:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.265214:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.265219:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.265223:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.265229:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.265235:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.265241:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.265247:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.265253:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.265259:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.265265:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.265285:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.265291:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.265297:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.265303:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.265308:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.272493:0:5849:0:(service.c:3206:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8f0d8491d600:5849] 0 exiting: rc = 1 00000100:00100000:3.0:1790740449.272617:0:5850:0:(service.c:3206:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8f0d8491d000:5850] 1 exiting: rc = 0 00000100:00100000:1.0:1790740449.272814:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.272821:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.272827:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.272832:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.272838:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.272843:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.272849:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.272853:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.272858:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.272862:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.272867:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.272871:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.272876:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.272881:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.272886:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.272890:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.272895:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.272900:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.272905:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.272909:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.272914:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.272929:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.272933:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.272953:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.272957:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.272962:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.272966:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.272972:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.272977:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.272982:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.272987:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.272992:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.272997:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.273002:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.273007:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.273012:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.273018:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.273023:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.273028:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.273033:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.273039:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.273044:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.273049:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.273055:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.273060:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.273066:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.273071:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.273075:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.273080:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.273085:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.273090:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.273096:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.273101:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.273106:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.273111:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.273117:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.273130:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.273134:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.273139:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.273144:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.273150:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.273155:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.273161:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.273166:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740449.273559:0:5851:0:(service.c:3206:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8f0d8491d400:5851] 0 exiting: rc = 1 00000100:00100000:0.0:1790740449.273974:0:5852:0:(service.c:3206:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8f0d8491c400:5852] 1 exiting: rc = 0 00000100:00100000:1.0:1790740449.274823:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.274831:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.274837:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.274842:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.274848:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.274854:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.274859:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.274864:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.274869:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.274874:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.274878:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.274884:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.274888:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.274893:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.274898:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.274903:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.274909:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.274914:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.274919:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.274924:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.274929:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.274933:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.274994:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.275000:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.275008:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.276029:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.276037:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.276136:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.276141:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.276146:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.276151:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.276156:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.276165:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.276171:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.276176:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.276181:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.276186:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.276191:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.276197:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.276202:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.276206:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.276210:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.276215:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.276219:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.276223:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.276228:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.276232:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.276237:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.276242:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.276247:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.276252:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.276257:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.276261:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.276266:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.276275:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.276280:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.276285:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.276289:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.276294:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.276299:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.276304:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.276309:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.276321:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.276326:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740449.276766:0:5854:0:(service.c:3206:ptlrpc_main()) mdt_fld_0001: service thread [ffff8f0d880e6e00:5854] 1 exiting: rc = 0 00000100:00100000:2.0:1790740449.277970:0:5853:0:(service.c:3206:ptlrpc_main()) mdt_fld_0000: service thread [ffff8f0db9a45c00:5853] 0 exiting: rc = 1 00000100:00100000:0.0:1790740449.278974:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.278982:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.278987:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.278993:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.278999:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.279004:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.279009:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.279014:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.279019:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.279025:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.279030:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.279034:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.279039:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.279044:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.279050:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.279054:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.279061:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.279068:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.279073:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.279078:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.279083:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.279088:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.279093:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.279099:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.279124:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.279130:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.279136:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.279141:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.279146:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.279162:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.279168:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.279173:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.279178:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.279183:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.279188:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.279193:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.279198:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.279204:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.279208:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.279214:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.279219:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.279224:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.279229:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.279235:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.279240:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.279245:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.279250:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.279255:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.279259:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.279264:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.279270:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.279275:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.279281:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.279286:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.279291:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.279296:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.279301:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.279306:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.279311:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.279324:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.279329:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.279333:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.279338:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.279343:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.280209:0:5857:0:(service.c:3206:ptlrpc_main()) mdt_io00_002: service thread [ffff8f0db9a45800:5857] 2 exiting: rc = 0 00000100:00100000:1.0:1790740449.280632:0:5855:0:(service.c:3206:ptlrpc_main()) mdt_io00_000: service thread [ffff8f0db9a44400:5855] 0 exiting: rc = 1 00000100:00100000:3.0:1790740449.281244:0:5856:0:(service.c:3206:ptlrpc_main()) mdt_io00_001: service thread [ffff8f0d83e37000:5856] 1 exiting: rc = 0 00000100:00100000:0.0:1790740449.281470:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.281478:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.281483:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.281489:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.281496:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.281597:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.281606:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.281613:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.281620:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.281633:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.281642:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.281652:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.281663:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.281671:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.281679:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.281685:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.281695:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.281701:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.281707:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.281712:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.281720:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.281728:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.281734:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.281739:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.281744:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.281749:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.281755:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.281761:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.281766:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.281796:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.281804:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.281812:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.281822:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.281833:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.281840:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.281859:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.281867:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.281876:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.281883:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.281892:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.281903:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.281912:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.281923:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.281932:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.281955:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.281968:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.281978:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.281986:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.281996:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.282005:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.282444:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.282453:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.282460:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.282483:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.282490:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.282495:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.282501:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.282507:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.282515:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.282520:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.282526:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.282532:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.282537:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740449.282543:0:12958:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1790740449.287828:0:12958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790740449.287840:0:12958:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1790740449.287845:0:12958:0:(genops.c:885:class_export_put()) final put ffff8f0d85316000/MDS_uuid 00000020:00000080:0.0:1790740449.287850:0:12958:0:(genops.c:844:class_export_destroy()) destroying export ffff8f0d85316000/MDS_uuid for MDS 00000020:01000000:0.0:1790740449.287856:0:12958:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1790740449.287985:0:12958:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1790740449.584687:0:11661:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740450.608831:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1790740451.595131:0:13109:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1790740451.608554:0:13109:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1790740451.608631:0:13109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977e00/0xc6b31a1b598e9c25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9c2c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740451.608648:0:13109:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977e00/0xc6b31a1b598e9c25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598e9c2c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740451.608655:0:13109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977e00/0xc6b31a1b598e9c25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b31a1b598e9c2c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740451.608662:0:13109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977e00/0xc6b31a1b598e9c25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b31a1b598e9c2c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740451.608698:0:13109:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1790740451.608703:0:13109:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1790740451.608731:0:13109:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790740451.608735:0:13109:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1790740451.608741:0:13109:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1790740451.608763:0:13109:0:(import.c:65:import_set_state_nolock()) ffff8f0c84c1b000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1790740451.608831:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1877727158291328:0@lo:39:umount.0 00000400:00000100:0.0:1790740451.608878:0:3302:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877727158291328 offset 0 length 224: 4 00010000:00010000:2.0:1790740451.612314:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790740451.612327:0:5831:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977e00/0xc6b31a1b598e9c25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b31a1b598e9c2c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740451.612340:0:5831:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f977e00 already unused, calling callback (ffffffffc1baec20) 10000000:00010000:2.0:1790740451.612344:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977e00/0xc6b31a1b598e9c25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b31a1b598e9c2c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740451.612377:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977e00/0xc6b31a1b598e9c25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xc6b31a1b598e9c2c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790740451.612385:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977e00/0xc6b31a1b598e9c25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xc6b31a1b598e9c2c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790740451.612391:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790740451.612395:0:5831:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1790740451.612397:0:5831:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1790740451.612439:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977e00/0xc6b31a1b598e9c25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6b31a1b598e9c2c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740451.612445:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790740451.612483:0:5831:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977e00/0xc6b31a1b598e9c25 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6b31a1b598e9c2c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740451.612491:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977e00/0xc6b31a1b598e9c25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6b31a1b598e9c2c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740451.612512:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740451.612514:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740451.612516:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740451.612553:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790740451.612596:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd7d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3305:1877727158291456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790740451.612658:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740451.612762:0:8506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158291456 00000100:00100000:2.0:1790740451.612770:0:8506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158291456 00000100:00100000:2.0:1790740451.612809:0:8506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790740451.612817:0:8506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3305:x1877727158291456:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1790740451.612824:0:8506:0:(ldlm_lockd.c:2567:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790740451 with bad export cookie 14317816345109895431 00010000:00010000:0.0:1790740451.632768:0:11661:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740451.635089:0:8506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3305:x1877727158291456:12345-0@lo:103:ldlm_bl.0 Request processed in 22264us (22424us total) trans 0 rc -107/-107 00000100:00100000:0.0:1790740451.635102:0:8506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1790740451.635192:0:3305:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.158@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1790740451.635198:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8f0d864fc800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1790740451.635202:0:3305:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1790740451.648603:0:3305:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.158@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1790740451.648609:0:3305:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1790740451.648618:0:3305:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f0dbd7d5500 x1877727158291456/t0(0) o103->MGC192.168.203.158@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790740467 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1790740451.648631:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1790740451.648634:0:3305:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1790740451.648635:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1790740451.648639:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8f0d864fc800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790740451.648644:0:3305:0:(import.c:545:import_select_connection()) MGC192.168.203.158@tcp: connect to NID 0@lo last attempt 145 00000100:00080000:1.0:1790740451.648657:0:3305:0:(import.c:666:import_select_connection()) MGC192.168.203.158@tcp: import ffff8f0d864fc800 using connection 192.168.203.158@tcp/0@lo 00000100:00100000:1.0:1790740451.648693:0:3305:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f0dbda74e00 x1877727158291584/t0(0) o250->MGC192.168.203.158@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790740451.648966:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3302:1877727158291584:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:0.0:1790740451.649010:0:3302:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877727158291584 offset 0 length 520: 4 00000100:00100000:0.0:1790740451.649056:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd7d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3305:1877727158291456:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790740452.656772:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790740452.656984:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 10ce3df1-3f26-4bb4-b4c3-d740981d121e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790740452.656992:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 10ce3df1-3f26-4bb4-b4c3-d740981d121e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1790740452.657078:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1b41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1877727158291712:0@lo:400:kworker.0 00000400:00000100:3.0:1790740452.657130:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877727158291712 offset 0 length 224: 4 00000001:00100000:1.0:1790740453.223685:0:7642:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790740453.223694:0:7642:0:(genops.c:885:class_export_put()) final put ffff8f0dc1a84000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790740453.223843:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f0dc1a84000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1790740453.223898:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f0dc1a86800 for lustre-OST0001 00010000:00010000:2.0:1790740453.682774:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740454.704822:0:11661:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740455.729081:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790740456.691538:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 10ce3df1-3f26-4bb4-b4c3-d740981d121e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790740456.691563:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 10ce3df1-3f26-4bb4-b4c3-d740981d121e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1790740456.691737:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd7d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1877727158291840:0@lo:400:kworker.0 00000400:00000100:1.0:1790740456.691792:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877727158291840 offset 0 length 224: 4 00010000:00010000:2.0:1790740456.753243:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740457.777035:0:11661:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740458.802703:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740459.827949:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740460.853502:0:11661:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740461.872762:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740461.872802:0:3302:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790740451/real 1790740451] req@ffff8f0dbda74e00 x1877727158291584/t0(0) o250->MGC192.168.203.158@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1790740461 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740461.872832:0:3302:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f0dbda74e00 x1877727158291584/t0(0) o250->MGC192.168.203.158@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1790740461 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740461.872842:0:3302:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790740451/real 1790740451] req@ffff8f0dbda76a00 x1877727158291328/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790740461 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740461.872898:0:3302:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f0dbda76a00 x1877727158291328/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790740461 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790740461.872916:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8f0d864fc800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790740461.872942:0:3302:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1790740461.872946:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3302:1877727158291584:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:0.0:1790740461.872952:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8f0c84c1b000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1790740461.872973:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1877727158291328:0@lo:39:umount.0 00000100:00080000:3.0:1790740461.873017:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 10ce3df1-3f26-4bb4-b4c3-d740981d121e->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790740461.873022:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1790740461.873026:0:38:0:(import.c:65:import_set_state_nolock()) ffff8f0d864fc800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790740461.873030:0:38:0:(import.c:545:import_select_connection()) MGC192.168.203.158@tcp: connect to NID 0@lo last attempt 367 00000100:00080000:3.0:1790740461.873036:0:38:0:(import.c:630:import_select_connection()) MGC192.168.203.158@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1790740461.873046:0:38:0:(import.c:666:import_select_connection()) MGC192.168.203.158@tcp: import ffff8f0d864fc800 using connection 192.168.203.158@tcp/0@lo 00000100:00100000:3.0:1790740461.873079:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f0db57a8380 x1877727158291968/t0(0) o250->MGC192.168.203.158@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790740461.873141:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790740461.873153:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db57a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1877727158292096:0@lo:400:kworker.0 00000100:00080000:1.0:1790740461.873190:0:13109:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790740461.873196:0:13109:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000400:00000100:3.0:1790740461.873198:0:3306:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877727158292096 offset 0 length 224: 4 00000100:00100000:1.0:1790740461.873202:0:13109:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:0.0:1790740461.873362:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db57a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3302:1877727158291968:0@lo:250:kworker.0 00000400:00000100:0.0:1790740461.873385:0:3302:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877727158291968 offset 0 length 520: 4 00010000:00010000:1.0:1790740461.874087:0:13109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9f498a00/0xc6b31a1b598e9c33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9c3a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740461.874099:0:13109:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9f498a00/0xc6b31a1b598e9c33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598e9c3a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740461.874106:0:13109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9f498a00/0xc6b31a1b598e9c33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b31a1b598e9c3a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740461.874113:0:13109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.158@tcp lock: ffff8f0d9f498a00/0xc6b31a1b598e9c33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b31a1b598e9c3a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740461.874150:0:13109:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790740461.874158:0:13109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea6e00/0xc6b31a1b598e9e6a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9e71 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740461.874165:0:13109:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea6e00/0xc6b31a1b598e9e6a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598e9e71 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740461.874170:0:13109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea6e00/0xc6b31a1b598e9e6a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b31a1b598e9e71 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740461.874175:0:13109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea6e00/0xc6b31a1b598e9e6a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b31a1b598e9e71 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740461.874196:0:13109:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1790740461.874201:0:13109:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00010000:00010000:3.0:1790740461.874220:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000020:01000004:1.0:1790740461.874225:0:13109:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00010000:00010000:3.0:1790740461.874228:0:5831:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.158@tcp lock: ffff8f0d9f498a00/0xc6b31a1b598e9c33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b31a1b598e9c3a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:1.0:1790740461.874231:0:13109:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1790740461.874238:0:13109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790740461.874243:0:13109:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1790740461.874250:0:13109:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff8f0dbeb4cd40) has no exports 00010000:00010000:3.0:1790740461.874257:0:5831:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f498a00 already unused, calling callback (ffffffffc1baec20) 10000000:00010000:3.0:1790740461.874262:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.158@tcp lock: ffff8f0d9f498a00/0xc6b31a1b598e9c33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b31a1b598e9c3a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740461.874271:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.158@tcp lock: ffff8f0d9f498a00/0xc6b31a1b598e9c33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xc6b31a1b598e9c3a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790740461.874278:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.158@tcp lock: ffff8f0d9f498a00/0xc6b31a1b598e9c33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xc6b31a1b598e9c3a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1790740461.874279:0:13109:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff8f0dbeb4cd40) has no exports 10000000:01000000:3.0:1790740461.874287:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1790740461.874291:0:5831:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1790740461.874293:0:5831:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1790740461.874304:0:5831:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f0d864fc800 00010000:00010000:3.0:1790740461.874309:0:5831:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.158@tcp lock: ffff8f0d9f498a00/0xc6b31a1b598e9c33 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xc6b31a1b598e9c3a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740461.874316:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.158@tcp lock: ffff8f0d9f498a00/0xc6b31a1b598e9c33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xc6b31a1b598e9c3a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740461.874329:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740461.874332:0:5831:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea6e00/0xc6b31a1b598e9e6a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b31a1b598e9e71 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740461.874338:0:5831:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9fea6e00 already unused, calling callback (ffffffffc1baec20) 10000000:00010000:3.0:1790740461.874340:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea6e00/0xc6b31a1b598e9e6a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b31a1b598e9e71 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740461.874347:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea6e00/0xc6b31a1b598e9e6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc6b31a1b598e9e71 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790740461.874359:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea6e00/0xc6b31a1b598e9e6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc6b31a1b598e9e71 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740461.874364:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1790740461.874366:0:5831:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1790740461.874368:0:5831:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1790740461.874374:0:5831:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f0d864fc800 00010000:00010000:3.0:1790740461.874377:0:5831:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea6e00/0xc6b31a1b598e9e6a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc6b31a1b598e9e71 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740461.874383:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea6e00/0xc6b31a1b598e9e6a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc6b31a1b598e9e71 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740461.874391:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740461.874393:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740461.874395:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740461.874445:0:11661:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1790740461.875991:0:13109:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff8f0d8749f960 - data ffff8f0da801e870/ffff8f0dbdafb800 00000020:01000000:1.0:1790740461.876104:0:13109:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff8f0dbd170f00 - data ffff8f0da287e870/ffff8f0c810cac00 00100000:10000000:2.0:1790740461.912992:0:13109:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1790740461.955803:0:13109:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc6b31a1b598e9a34 00000020:00000080:2.0:1790740461.955854:0:13109:0:(genops.c:885:class_export_put()) final put ffff8f0db7a35800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1790740461.955871:0:13109:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f0d83fe1000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1790740461.955874:0:13109:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f0d83fe1000 2 00000020:01000004:2.0:1790740461.955878:0:13109:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8f0d83fe1000 from lustre-OST0000 00000020:00000080:2.0:1790740461.955900:0:13109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790740461.955908:0:13109:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1790740461.955911:0:13109:0:(genops.c:885:class_export_put()) final put ffff8f0dc1f27800/lustre-OST0000_UUID 00000020:00000080:2.0:1790740461.955914:0:13109:0:(genops.c:844:class_export_destroy()) destroying export ffff8f0dc1f27800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1790740461.955920:0:13109:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1790740461.955991:0:13109:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1790740461.955996:0:13109:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1790740461.956000:0:13109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790740461.956005:0:13109:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1790740461.956012:0:13109:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8f0d88142000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790740461.956017:0:13109:0:(genops.c:1552:class_disconnect_exports()) OBD device 12 (ffff8f0db5a70000) has exports, disconnecting them 00000020:00080000:2.0:1790740461.956021:0:13109:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8f0d88142000), last request at 1790740246 00000020:00000080:2.0:1790740461.956025:0:13109:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc6b31a1b598e9a5e 00000020:00080000:2.0:1790740461.956035:0:13109:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f0d88142000): rc 0 00000020:00000080:2.0:1790740461.956039:0:13109:0:(genops.c:885:class_export_put()) final put ffff8f0d88142000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1790740461.956927:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f0db7a35800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1790740461.956940:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f0d88142000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1790740461.957699:0:13109:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1790740461.957704:0:13109:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790740461.957709:0:13109:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1790740461.957715:0:13109:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1790740461.957893:0:13109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790740461.957900:0:13109:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:3.0:1790740461.957906:0:13109:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f0d83fe1000 1 00000020:00000080:3.0:1790740461.957911:0:13109:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc6b31a1b598e99ee 00000020:00000080:3.0:1790740461.957916:0:13109:0:(genops.c:885:class_export_put()) final put ffff8f0dc1f20000/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1790740461.957922:0:13109:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1790740461.957926:0:13109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790740461.957939:0:13109:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1790740461.957943:0:13109:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff8f0d87f44d40) has no exports 00000020:00000080:0.0:1790740461.958139:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f0c84c1b000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1790740461.958147:0:38:0:(genops.c:885:class_export_put()) final put ffff8f0c84c1e800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1790740461.958149:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f0c84c1e800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1790740461.958156:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1790740461.958201:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f0dc1f20000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1790740461.984165:0:13109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790740461.984180:0:13109:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1790740461.984185:0:13109:0:(genops.c:885:class_export_put()) final put ffff8f0d83fe6000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1790740461.984190:0:13109:0:(genops.c:844:class_export_destroy()) destroying export ffff8f0d83fe6000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1790740461.984200:0:13109:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1790740461.984333:0:13109:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8f0d83fe7000 00000020:02000400:0.0:1790740461.984388:0:13109:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1790740462.899122:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740463.923359:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740464.944719:0:11661:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1790740465.416532:0:13263:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1790740465.433773:0:13263:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1790740465.433857:0:13263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976c00/0xc6b31a1b598e9c09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9c10 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740465.433872:0:13263:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976c00/0xc6b31a1b598e9c09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598e9c10 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740465.433880:0:13263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976c00/0xc6b31a1b598e9c09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b31a1b598e9c10 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740465.433887:0:13263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976c00/0xc6b31a1b598e9c09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b31a1b598e9c10 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740465.433937:0:13263:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1790740465.433942:0:13263:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1790740465.433964:0:13263:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790740465.433975:0:13263:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f0dc1b41f80 x1877727158291712/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740468 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740465.433995:0:13263:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f0dbd7d6d80 x1877727158291840/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740472 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740465.434020:0:13263:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f0db57a8700 x1877727158292096/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740477 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740465.434032:0:13263:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1790740465.434037:0:13263:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1790740465.434066:0:13263:0:(import.c:65:import_set_state_nolock()) ffff8f0db5616000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1790740465.434110:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db57a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1877727158292096:0@lo:400:kworker.0 00000100:00100000:3.0:1790740465.434155:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db57a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1877727158292224:0@lo:39:umount.0 00000400:00000100:3.0:1790740465.434192:0:3302:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877727158292224 offset 0 length 224: 4 00000100:00100000:2.0:1790740465.436019:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd7d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1877727158291840:0@lo:400:kworker.0 00000100:00100000:1.0:1790740465.436671:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1b41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1877727158291712:0@lo:400:kworker.0 00010000:00010000:0.0:1790740465.438238:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790740465.438266:0:5832:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976c00/0xc6b31a1b598e9c09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b31a1b598e9c10 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740465.438277:0:5832:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f976c00 already unused, calling callback (ffffffffc1baec20) 10000000:00010000:0.0:1790740465.438281:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976c00/0xc6b31a1b598e9c09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b31a1b598e9c10 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740465.438291:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976c00/0xc6b31a1b598e9c09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc6b31a1b598e9c10 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790740465.438297:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976c00/0xc6b31a1b598e9c09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc6b31a1b598e9c10 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740465.438302:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790740465.438304:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1790740465.438307:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1790740465.438324:0:5832:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f0d864fc800 00010000:00010000:0.0:1790740465.438328:0:5832:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976c00/0xc6b31a1b598e9c09 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc6b31a1b598e9c10 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740465.438336:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.158@tcp lock: ffff8f0d9f976c00/0xc6b31a1b598e9c09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc6b31a1b598e9c10 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740465.438349:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740465.438351:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740465.438352:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740465.968788:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740466.992730:0:11661:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790740466.992868:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 10ce3df1-3f26-4bb4-b4c3-d740981d121e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790740466.992875:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 10ce3df1-3f26-4bb4-b4c3-d740981d121e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1790740468.018724:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740469.041145:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740470.065431:0:11661:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740471.088821:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790740472.112690:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 10ce3df1-3f26-4bb4-b4c3-d740981d121e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790740472.112701:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 10ce3df1-3f26-4bb4-b4c3-d740981d121e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1790740472.113235:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740473.136756:0:11661:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740474.160916:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740475.186378:0:5831:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740475.696910:0:3302:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790740465/real 1790740465] req@ffff8f0db57a9f80 x1877727158292224/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790740475 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740475.696942:0:3302:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f0db57a9f80 x1877727158292224/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790740475 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790740475.696961:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8f0db5616000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1790740475.696981:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db57a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1877727158292224:0@lo:39:umount.0 00000100:00080000:3.0:1790740475.697065:0:13263:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790740475.697069:0:13263:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1790740475.697074:0:13263:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1790740475.698011:0:13263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7a00/0xc6b31a1b598e9c17 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9c1e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740475.698027:0:13263:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7a00/0xc6b31a1b598e9c17 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598e9c1e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740475.698035:0:13263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7a00/0xc6b31a1b598e9c17 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b31a1b598e9c1e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740475.698041:0:13263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7a00/0xc6b31a1b598e9c17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b31a1b598e9c1e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740475.698060:0:13263:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790740475.698067:0:13263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea6200/0xc6b31a1b598e9e5c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598e9e63 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740475.698073:0:13263:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea6200/0xc6b31a1b598e9e5c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598e9e63 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740475.698092:0:13263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea6200/0xc6b31a1b598e9e5c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b31a1b598e9e63 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740475.698098:0:13263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea6200/0xc6b31a1b598e9e5c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b31a1b598e9e63 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740475.698122:0:13263:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1790740475.698127:0:13263:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1790740475.698148:0:13263:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1790740475.698152:0:13263:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1790740475.698157:0:13263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790740475.698162:0:13263:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1790740475.698166:0:13263:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff8f0d87f43380) has no exports 00000020:00080000:3.0:1790740475.698187:0:13263:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff8f0d87f43380) has no exports 00000020:01000000:3.0:1790740475.699932:0:13263:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff8f0d8509d600 - data ffff8f0dae7f5ca8/ffff8f0dbee3fc00 00000020:01000000:3.0:1790740475.700049:0:13263:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff8f0c875ea240 - data ffff8f0da801f000/ffff8f0c87930400 00010000:00010000:2.0:1790740475.700700:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790740475.700711:0:5832:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7a00/0xc6b31a1b598e9c17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b31a1b598e9c1e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740475.700739:0:5832:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9fea7a00 already unused, calling callback (ffffffffc1baec20) 10000000:00010000:2.0:1790740475.700743:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7a00/0xc6b31a1b598e9c17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b31a1b598e9c1e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740475.700763:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7a00/0xc6b31a1b598e9c17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc6b31a1b598e9c1e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790740475.700770:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7a00/0xc6b31a1b598e9c17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc6b31a1b598e9c1e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790740475.700775:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790740475.700777:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1790740475.700780:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1790740475.700794:0:5832:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f0d864fc800 00010000:00010000:2.0:1790740475.700799:0:5832:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7a00/0xc6b31a1b598e9c17 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc6b31a1b598e9c1e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740475.700806:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea7a00/0xc6b31a1b598e9c17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc6b31a1b598e9c1e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740475.700816:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790740475.700820:0:5832:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea6200/0xc6b31a1b598e9e5c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b31a1b598e9e63 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740475.700824:0:5832:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9fea6200 already unused, calling callback (ffffffffc1baec20) 10000000:00010000:2.0:1790740475.700827:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea6200/0xc6b31a1b598e9e5c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b31a1b598e9e63 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740475.700833:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea6200/0xc6b31a1b598e9e5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc6b31a1b598e9e63 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790740475.700845:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea6200/0xc6b31a1b598e9e5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc6b31a1b598e9e63 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790740475.700851:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1790740475.700853:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1790740475.700855:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1790740475.700861:0:5832:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f0d864fc800 00010000:00010000:2.0:1790740475.700863:0:5832:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea6200/0xc6b31a1b598e9e5c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xc6b31a1b598e9e63 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740475.700870:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.158@tcp lock: ffff8f0d9fea6200/0xc6b31a1b598e9e5c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xc6b31a1b598e9e63 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740475.700882:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740475.700883:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740475.700885:0:5832:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740475.705986:0:11661:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1790740475.711393:0:13263:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1790740475.744867:0:13263:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc6b31a1b598e9b0d 00000020:00000080:1.0:1790740475.744876:0:13263:0:(genops.c:885:class_export_put()) final put ffff8f0d83ee9000/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1790740475.744887:0:13263:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f0db562c800 from lustre-OST0001, refs=2 00000020:01000004:1.0:1790740475.744890:0:13263:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f0db562c800 2 00000020:01000004:1.0:1790740475.744903:0:13263:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8f0db562c800 from lustre-OST0001 00000020:00000080:1.0:1790740475.744924:0:13263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790740475.744934:0:13263:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1790740475.744937:0:13263:0:(genops.c:885:class_export_put()) final put ffff8f0d83eea000/lustre-OST0001_UUID 00000020:00000080:1.0:1790740475.744940:0:13263:0:(genops.c:844:class_export_destroy()) destroying export ffff8f0d83eea000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1790740475.744949:0:13263:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1790740475.745068:0:13263:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 10ce3df1-3f26-4bb4-b4c3-d740981d121e->MGS 00010000:00010000:1.0:1790740475.745084:0:13263:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d2600/0xc6b31a1b598e9a11 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc6b31a1b598e9a18 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790740475.745096:0:13263:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d2600/0xc6b31a1b598e9a11 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc6b31a1b598e9a18 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790740475.745102:0:13263:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1790740475.745105:0:13263:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1790740475.745108:0:13263:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1790740475.745120:0:13263:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f0d864fc800 00010000:00010000:1.0:1790740475.745124:0:13263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.158@tcp lock: ffff8f0dc21d2600/0xc6b31a1b598e9a11 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc6b31a1b598e9a18 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740475.745138:0:13263:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.158@tcp lock: ffff8f0d9f498800/0xc6b31a1b598e9c5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc6b31a1b598e9c64 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790740475.745145:0:13263:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.158@tcp lock: ffff8f0d9f498800/0xc6b31a1b598e9c5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc6b31a1b598e9c64 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790740475.745150:0:13263:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1790740475.745152:0:13263:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1790740475.745154:0:13263:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1790740475.745162:0:13263:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f0d864fc800 00010000:00010000:1.0:1790740475.745165:0:13263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.158@tcp lock: ffff8f0d9f498800/0xc6b31a1b598e9c5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc6b31a1b598e9c64 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1790740475.745204:0:13263:0:(import.c:65:import_set_state_nolock()) ffff8f0d864fc800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1790740475.745208:0:13263:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1790740475.745211:0:13263:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1790740475.745212:0:13263:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1790740475.745217:0:13263:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1790740475.745226:0:13263:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f0db57a8380 x1877727158291968/t0(0) o250->MGC192.168.203.158@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1790740476 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1790740475.745250:0:13263:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1790740475.745252:0:13263:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 1s for inflight to error out 00000100:00100000:2.0:1790740475.745610:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db57a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:10ce3df1-3f26-4bb4-b4c3-d740981d121e:3302:1877727158291968:0@lo:250:kworker.0 00000020:00000080:0.0:1790740475.745641:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f0d83ee9000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:01000000:1.0:1790740475.746403:0:13263:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1790740475.746415:0:13263:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc6b31a1b598e9900 00000020:00000080:1.0:1790740475.746421:0:13263:0:(genops.c:885:class_export_put()) final put ffff8f0db1fca800/10ce3df1-3f26-4bb4-b4c3-d740981d121e 00000020:01000000:1.0:1790740475.746821:0:13263:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.158@tcp (flags='') 00000020:00000080:1.0:1790740475.746830:0:13263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790740475.746838:0:13263:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.158@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1790740475.746843:0:13263:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff8f0d87f419c0) has no exports 10000000:01000000:2.0:1790740475.748907:0:5841:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1790740475.749004:0:13263:0:(obd_class.h:668:obd_cleanup_client_import()) MGC192.168.203.158@tcp: client import never connected 00000100:00080000:2.0:1790740475.749008:0:13263:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1790740475.749011:0:13263:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1790740475.749014:0:13263:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1790740475.749017:0:13263:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1790740475.757218:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f0db1fca800/10ce3df1-3f26-4bb4-b4c3-d740981d121e for MGC192.168.203.158@tcp 00000020:00000080:2.0:1790740475.764905:0:13263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790740475.764920:0:13263:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.158@tcp (uuid 10ce3df1-3f26-4bb4-b4c3-d740981d121e) 00000020:01000000:2.0:1790740475.764928:0:13263:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1790740475.764936:0:13263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790740475.764941:0:13263:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1790740475.764949:0:13263:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8f0db6f48800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790740475.764969:0:13263:0:(genops.c:1552:class_disconnect_exports()) OBD device 16 (ffff8f0db6d799c0) has exports, disconnecting them 00000020:00080000:2.0:1790740475.764974:0:13263:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8f0db6f48800), last request at 1790740263 00000020:00000080:2.0:1790740475.764978:0:13263:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc6b31a1b598e9b37 00000020:00080000:2.0:1790740475.764996:0:13263:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f0db6f48800): rc 0 00000020:00000080:2.0:1790740475.765002:0:13263:0:(genops.c:885:class_export_put()) final put ffff8f0db6f48800/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1790740475.765811:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f0d864fc800 for MGC192.168.203.158@tcp 00000020:00000080:0.0:1790740475.765878:0:8:0:(genops.c:885:class_export_put()) final put ffff8f0d864fd800/10ce3df1-3f26-4bb4-b4c3-d740981d121e 00000020:00000080:0.0:1790740475.765886:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f0d864fd800/10ce3df1-3f26-4bb4-b4c3-d740981d121e for MGC192.168.203.158@tcp 00000020:01000000:0.0:1790740475.766050:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.158@tcp (10ce3df1-3f26-4bb4-b4c3-d740981d121e) 00000020:00000080:0.0:1790740475.766307:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f0db6f48800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1790740475.766651:0:13263:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1790740475.766657:0:13263:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790740475.766660:0:13263:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1790740475.766665:0:13263:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790740475.766720:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f0db5616000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1790740475.766845:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1790740475.769907:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1790740475.772553:0:11661:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1790740475.773148:0:5826:0:(service.c:3206:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8f0d94614800:5826] 0 exiting: rc = 1 00000100:00100000:0.0:1790740475.773149:0:5827:0:(service.c:3206:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8f0d94615800:5827] 1 exiting: rc = 0 00000100:00100000:1.0:1790740475.773474:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740475.773763:0:5829:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8f0d8962ce00:5829] 1 exiting: rc = 0 00000100:00100000:3.0:1790740475.773833:0:5830:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8f0d90be7600:5830] 2 exiting: rc = 0 00000100:00100000:0.0:1790740475.773895:0:5828:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8f0d90be7000:5828] 0 exiting: rc = 1 00000100:00100000:0.0:1790740475.773969:0:8506:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8f0db570be00:8506] 3 exiting: rc = 0 00000100:00100000:0.0:1790740475.774027:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.774045:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.774052:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.774057:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.774063:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.774069:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.774075:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.774081:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.774087:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.774094:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.774105:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.774111:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.774117:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.774123:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.774130:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.774136:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.774142:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.774147:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.774152:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.774158:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.774169:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.774175:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.774180:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.774185:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.774195:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.774201:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.774206:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.774211:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.774217:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.774222:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.774227:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.774233:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.774238:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.774243:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.774247:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.774252:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.774264:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.774269:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.774273:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.774279:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.774284:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.774289:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.774296:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.774301:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.774306:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.774311:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.774322:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.774327:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.774333:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.774338:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.774354:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.774361:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.774367:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.774372:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.774378:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.774383:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.774388:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.774393:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.774399:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.774404:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.774409:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.774415:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.774420:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.774426:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1790740475.796834:0:13263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790740475.796847:0:13263:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1790740475.796853:0:13263:0:(genops.c:885:class_export_put()) final put ffff8f0db6f4d000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1790740475.796857:0:13263:0:(genops.c:844:class_export_destroy()) destroying export ffff8f0db6f4d000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1790740475.796867:0:13263:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1790740475.797074:0:13263:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f0db562c800 1 00000020:00000080:0.0:1790740475.797122:0:13263:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc6b31a1b598e9adc 00000020:00000080:0.0:1790740475.797129:0:13263:0:(genops.c:885:class_export_put()) final put ffff8f0db562d000/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1790740475.797145:0:13263:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1790740475.797150:0:13263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790740475.797155:0:13263:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1790740475.797160:0:13263:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff8f0db6f5b380) has no exports 00000020:00000080:1.0:1790740475.797725:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f0db562d000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1790740475.846766:0:13263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790740475.846779:0:13263:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1790740475.846784:0:13263:0:(genops.c:885:class_export_put()) final put ffff8f0db562f800/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1790740475.846789:0:13263:0:(genops.c:844:class_export_destroy()) destroying export ffff8f0db562f800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1790740475.846798:0:13263:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1790740475.846987:0:13263:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8f0db562e000 00000020:01000000:1.0:1790740475.847005:0:13263:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1790740475.847009:0:13263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790740475.847013:0:13263:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1790740475.847026:0:13263:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff8f0dbeb499c0) has no exports 00000020:00000080:1.0:1790740475.847046:0:13263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790740475.847052:0:13263:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1790740475.847054:0:13263:0:(genops.c:885:class_export_put()) final put ffff8f0dc1f23800/OSS_uuid 00000020:00000080:1.0:1790740475.847057:0:13263:0:(genops.c:844:class_export_destroy()) destroying export ffff8f0dc1f23800/OSS_uuid for OSS 00000020:01000000:1.0:1790740475.847061:0:13263:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1790740475.847135:0:6700:0:(service.c:3206:ptlrpc_main()) ll_ost00_001: service thread [ffff8f0d875ebe00:6700] 1 exiting: rc = 0 00000100:00100000:1.0:1790740475.847211:0:6699:0:(service.c:3206:ptlrpc_main()) ll_ost00_000: service thread [ffff8f0dc1f1dc00:6699] 0 exiting: rc = 1 00000100:00100000:1.0:1790740475.847268:0:12467:0:(service.c:3206:ptlrpc_main()) ll_ost00_004: service thread [ffff8f0c865e2a00:12467] 4 exiting: rc = 0 00000100:00080000:2.0:1790740475.847417:0:5838:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1790740475.848663:0:6701:0:(service.c:3206:ptlrpc_main()) ll_ost00_002: service thread [ffff8f0db570e000:6701] 2 exiting: rc = 0 00000100:00100000:2.0:1790740475.850670:0:8460:0:(service.c:3206:ptlrpc_main()) ll_ost00_003: service thread [ffff8f0d864a8c00:8460] 3 exiting: rc = 0 00000100:00100000:1.0:1790740475.850828:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.850839:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.850845:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.850852:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.850857:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.850862:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.850867:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.850872:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.850877:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.850882:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.850887:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.850892:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.850897:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.850903:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.850908:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.850913:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.850918:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.850923:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.850939:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.850945:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.850952:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.850957:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.850961:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.850966:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.850971:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.850993:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.850997:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.851002:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.851007:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.851012:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.851017:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.851021:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.851025:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.851030:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.851035:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.851039:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.851044:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.851049:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.851053:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.851058:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.851062:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.851067:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.851072:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.851076:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.851081:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.851087:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.851091:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.851096:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.851101:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.851107:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.851112:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.851117:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.851122:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.851128:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.851132:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.851137:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.851142:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.851147:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.851152:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.851156:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.851166:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.851171:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.851176:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.851185:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740475.856774:0:6703:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8f0db570fa00:6703] 0 exiting: rc = 1 00000100:00100000:3.0:1790740475.856865:0:6704:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8f0dc1f1ce00:6704] 1 exiting: rc = 0 00000100:00100000:1.0:1790740475.860342:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.860353:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.860359:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.860365:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.860370:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.860375:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.860381:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.860387:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.860393:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.860399:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.860405:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.860411:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.860417:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.860423:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.860429:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.860434:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.860440:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.860446:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.860450:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.860456:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.860462:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.860467:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.860473:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.860478:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.860485:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.860490:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.860496:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.860501:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.860506:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.860512:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.860517:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.860539:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.860545:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.860550:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.860556:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.860562:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.860568:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.860590:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.860597:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.860602:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.860630:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.860636:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.860642:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.860648:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.860653:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.860659:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.860665:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.860670:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.860676:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.860681:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.860687:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.860692:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.860697:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.860702:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.860708:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.860714:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.860720:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.860726:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.860733:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.860740:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.860757:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.860764:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.860769:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.860776:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790740475.861915:0:6706:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8f0dac094a00:6706] 1 exiting: rc = 0 00000100:00100000:2.0:1790740475.863046:0:6705:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8f0dae893c00:6705] 0 exiting: rc = 1 00000100:00100000:1.0:1790740475.863896:0:6707:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8f0dac094200:6707] 2 exiting: rc = 0 00000100:00100000:2.0:1790740475.864360:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740475.864369:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740475.864375:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740475.864381:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740475.864386:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740475.864392:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740475.864398:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740475.864403:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740475.864409:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740475.864415:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740475.864421:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740475.864426:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740475.864431:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740475.864437:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740475.864453:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740475.864459:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740475.864466:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740475.864472:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740475.864477:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740475.864482:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740475.864489:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740475.864495:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740475.864501:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740475.864507:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740475.864526:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740475.864531:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740475.864536:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740475.864542:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740475.864548:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740475.864553:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740475.864559:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740475.864564:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740475.864568:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740475.866014:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740475.866027:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740475.866033:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740475.866039:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740475.866044:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740475.866070:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740475.866078:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740475.866083:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740475.866088:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740475.866093:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740475.866098:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740475.866104:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740475.866109:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740475.866115:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740475.866121:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740475.866126:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740475.866131:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740475.866136:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740475.866141:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740475.866147:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740475.866152:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740475.866157:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740475.866162:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740475.866168:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740475.866191:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740475.866196:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740475.866226:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740475.866231:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740475.866238:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740475.866253:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790740475.866260:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.885865:0:6709:0:(service.c:3206:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8f0d874e6800:6709] 1 exiting: rc = 0 00000100:00100000:0.0:1790740475.886915:0:6708:0:(service.c:3206:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8f0db570e400:6708] 0 exiting: rc = 1 00000100:00100000:1.0:1790740475.887089:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.887112:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.887117:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.887124:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.887130:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.887134:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.887140:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.887145:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.887150:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.887156:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.887161:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.887166:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.887172:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.887177:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.887183:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.887188:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.887192:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.887197:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.887203:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.887208:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.887213:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.887218:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.887223:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.887228:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.887233:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.887239:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.887244:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.887249:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.887253:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.887259:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.887263:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.887278:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.887284:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.887289:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.887295:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.887300:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.887313:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.887319:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.887324:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.887330:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.887335:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.887340:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.887355:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.887361:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.887367:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.887373:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.887378:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.887383:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.887389:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.887394:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.887399:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.887405:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.887410:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.887417:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.887422:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.887427:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.887479:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.887484:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.887489:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.887494:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.887498:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.887503:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.887507:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790740475.887522:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.893954:0:6711:0:(service.c:3206:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8f0d849c6600:6711] 1 exiting: rc = 0 00000100:00100000:3.0:1790740475.895908:0:6710:0:(service.c:3206:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8f0dac095200:6710] 0 exiting: rc = 1 00000100:00100000:0.0:1790740475.896418:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.896427:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.896434:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.896440:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.896453:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.896460:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.896466:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.896472:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.896516:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.896525:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.896531:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.896542:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.896551:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.896558:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.896564:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.896594:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.896616:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.896622:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.896628:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.896639:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.896659:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.896673:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.896679:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.896685:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.896692:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.896716:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.896721:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.896727:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.896733:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.896738:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.896757:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.896764:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.896782:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.896789:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.896795:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.896809:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.896815:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.896821:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.896828:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.896840:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.896846:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.896851:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.896857:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.896869:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.896890:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.896905:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.896912:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.896918:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.896924:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.896942:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.896949:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.896955:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.896961:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.896974:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.896981:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.896987:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.897014:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.897022:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.897027:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.897033:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.897046:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.897051:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.897057:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790740475.897063:0:13263:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1790740475.920151:0:13263:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1790740492.554515:0:13878:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg358-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1790740501.694784:0:14338:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1790740501.694791:0:14338:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1790740501.695738:0:14338:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8f0c86750000 00000020:01000004:0.0:1790740501.695755:0:14338:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1790740501.695763:0:14338:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1790740501.695778:0:14338:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8f0db6d799c0) 00000020:00000080:0.0:1790740501.695792:0:14338:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1790740501.726807:0:14338:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1790740501.731712:0:14338:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:0.0:1790740501.732297:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:0.0:1790740501.732449:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:0.0:1790740501.732537:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:0.0:1790740501.733819:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:0.0:1790740501.734330:0:14338:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1790740501.734403:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:0.0:1790740501.734518:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:0.0:1790740501.734831:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:0.0:1790740501.735852:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 589: rc = 0 00100000:10000000:0.0:1790740501.735953:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 589: rc = 0 00100000:10000000:0.0:1790740501.736341:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 772: rc = 0 00100000:10000000:0.0:1790740501.736750:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 772: rc = 0 00100000:10000000:0.0:1790740501.736998:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 772: rc = 0 00100000:10000000:0.0:1790740501.737241:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 772: rc = 0 00100000:10000000:0.0:1790740501.740955:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 772: rc = 0 00100000:10000000:0.0:1790740501.741348:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 772: rc = 0 00100000:10000000:0.0:1790740501.743750:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 772: rc = 0 00100000:10000000:0.0:1790740501.745174:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 772: rc = 0 00100000:10000000:0.0:1790740501.746200:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 772: rc = 0 00100000:10000000:0.0:1790740501.747194:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 772: rc = 0 00100000:10000000:0.0:1790740501.747743:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 772: rc = 0 00100000:10000000:0.0:1790740501.748739:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 772: rc = 0 00100000:10000000:0.0:1790740501.750307:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 787: rc = 0 00100000:10000000:0.0:1790740501.751356:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 787: rc = 0 00100000:10000000:0.0:1790740501.752290:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 787: rc = 0 00100000:10000000:2.0:1790740501.759492:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 787: rc = 0 00100000:10000000:2.0:1790740501.759862:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 787: rc = 0 00100000:10000000:2.0:1790740501.760144:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 787: rc = 0 00100000:10000000:2.0:1790740501.760387:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 787: rc = 0 00100000:10000000:2.0:1790740501.761268:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 787: rc = 0 00100000:10000000:2.0:1790740501.762187:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 787: rc = 0 00100000:10000000:2.0:1790740501.763170:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 787: rc = 0 00100000:10000000:2.0:1790740501.764456:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 787: rc = 0 00100000:10000000:2.0:1790740501.764787:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 787: rc = 0 00100000:10000000:2.0:1790740501.765451:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 787: rc = 0 00100000:10000000:2.0:1790740501.765824:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 787: rc = 0 00100000:10000000:2.0:1790740501.766165:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 787: rc = 0 00100000:10000000:2.0:1790740501.766403:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 787: rc = 0 00100000:10000000:2.0:1790740501.767695:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 787: rc = 0 00100000:10000000:2.0:1790740501.767943:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 787: rc = 0 00100000:10000000:2.0:1790740501.768205:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 787: rc = 0 00100000:10000000:2.0:1790740501.768475:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 787: rc = 0 00100000:10000000:2.0:1790740501.768760:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 787: rc = 0 00100000:10000000:2.0:1790740501.768997:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 787: rc = 0 00100000:10000000:2.0:1790740501.770778:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 787: rc = 0 00100000:10000000:2.0:1790740501.771144:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 787: rc = 0 00100000:10000000:2.0:1790740501.771368:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 787: rc = 0 00100000:10000000:2.0:1790740501.771825:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 787: rc = 0 00100000:10000000:2.0:1790740501.772259:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 787: rc = 0 00100000:10000000:2.0:1790740501.772691:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 787: rc = 0 00100000:10000000:2.0:1790740501.772926:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 787: rc = 0 00100000:10000000:2.0:1790740501.775402:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 787: rc = 0 00100000:10000000:2.0:1790740501.778430:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 787: rc = 0 00100000:10000000:2.0:1790740501.779551:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 787: rc = 0 00100000:10000000:2.0:1790740501.780290:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 595: rc = 0 00100000:10000000:2.0:1790740501.786511:0:14338:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1790740501.786883:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 590: rc = 0 00100000:10000000:2.0:1790740501.787157:0:14338:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1790740501.787228:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 590: rc = 0 00100000:10000000:2.0:1790740501.787404:0:14338:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1790740501.787473:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 590: rc = 0 00100000:10000000:2.0:1790740501.787844:0:14338:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1790740501.787901:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 770: rc = 0 00100000:10000000:2.0:1790740501.789189:0:14338:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1790740501.789285:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 770: rc = 0 00100000:10000000:2.0:1790740501.789515:0:14338:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1790740501.789615:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 770: rc = 0 00000020:00000080:2.0:1790740501.790501:0:14338:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1790740501.790509:0:14338:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790740501.790519:0:14338:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc6b31a1b598eabf3 00000020:01000004:2.0:1790740501.790526:0:14338:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1790740501.790532:0:14338:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1790740501.790538:0:14338:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8f0c86750000 from MGS 00000020:01000004:2.0:1790740501.790549:0:14338:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1790740501.790569:0:14338:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8f0db6f58000) 00000020:00000080:2.0:1790740501.790628:0:14338:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1790740501.790677:0:14338:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f0c86750000 from MGS, refs=2 00080000:01000000:2.0:1790740501.790681:0:14338:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1790740501.790749:0:14338:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc6b31a1b598eac01 00000100:00100000:2.0:1790740501.790842:0:14338:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1790740501.791490:0:14338:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1790740501.791497:0:14338:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1790740501.794890:0:14338:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1790740501.794908:0:14338:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1790740501.796114:0:14338:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790740501.796495:0:14338:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1790740501.796502:0:14338:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1790740501.797541:0:14338:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1790740501.797550:0:14338:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1790740501.798787:0:14338:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1790740501.798811:0:14338:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1790740501.800187:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740501.800191:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740501.800203:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740501.800959:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740501.800971:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740501.800973:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740501.803121:0:14338:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1790740501.808258:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1790740501.826893:0:14338:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1790740501.826909:0:14338:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1790740501.826912:0:14338:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1790740501.834810:0:14347:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1790740501.835229:0:14338:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1790740501.836206:0:14338:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1790740501.842046:0:14338:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1790740501.842363:0:14338:0:(service.c:173:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790740501.842534:0:14338:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1790740501.842541:0:14338:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1790740501.843472:0:14338:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1790740501.843481:0:14338:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1790740501.847474:0:14338:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1790740501.847486:0:14338:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1790740501.850223:0:14338:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1790740501.850245:0:14338:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.158@tcp' 00000020:01000004:1.0:1790740501.850247:0:14338:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1790740501.850272:0:14338:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.158@tcp (typ=mgc) 00000020:00000080:1.0:1790740501.850284:0:14338:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.158@tcp (ffff8f0db5a719c0) 00000020:00000080:1.0:1790740501.850299:0:14338:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1790740501.850368:0:14338:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f0dbeb5a000@MGC192.168.203.158@tcp: add connection 192.168.203.158@tcp at head 00010000:00010000:1.0:1790740501.850525:0:14338:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.158@tcp-0 is initialized 00000040:01000000:1.0:1790740501.850531:0:14338:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.158@tcp ctxt 1 is initialized 00000100:00080000:3.0:1790740501.851014:0:14352:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1790740501.851139:0:14353:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1790740501.851210:0:14338:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.158@tcp (uuid 752c79c8-24e4-410a-832f-aac51b94c085) 00000020:00000080:2.0:1790740501.851226:0:14338:0:(genops.c:1384:class_connect()) connect: client 752c79c8-24e4-410a-832f-aac51b94c085, cookie 0xc6b31a1b598eac0f 00000100:00080000:2.0:1790740501.851236:0:14338:0:(import.c:545:import_select_connection()) MGC192.168.203.158@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790740501.851243:0:14338:0:(import.c:666:import_select_connection()) MGC192.168.203.158@tcp: import ffff8f0dbeb5a000 using connection 192.168.203.158@tcp/0@lo 00000100:00100000:2.0:1790740501.851274:0:14338:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f0dbd7d6d80 x1877727158292352/t0(0) o250->MGC192.168.203.158@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790740501.851302:0:14338:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 752c79c8-24e4-410a-832f-aac51b94c085->MGS 00000020:01000004:2.0:1790740501.851326:0:14338:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1790740501.851331:0:14338:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1790740501.851343:0:14338:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8f0db6f599c0) 00000020:00000080:2.0:1790740501.851353:0:14338:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1790740501.851639:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd7d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:752c79c8-24e4-410a-832f-aac51b94c085:3302:1877727158292352:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1790740501.851708:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740501.858814:0:14349:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158292352 00000100:00100000:3.0:1790740501.858829:0:14349:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158292352 00000100:00100000:3.0:1790740501.858867:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790740501.858874:0:14349:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d88286450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3302:x1877727158292352:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1790740501.858901:0:14349:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 752c79c8-24e4-410a-832f-aac51b94c085@0@lo t0 exp 0000000000000000 cur 417 last 0 00000020:00000080:3.0:1790740501.858933:0:14349:0:(genops.c:1384:class_connect()) connect: client 752c79c8-24e4-410a-832f-aac51b94c085, cookie 0xc6b31a1b598eac1d 00000100:00080000:3.0:1790740501.859063:0:14349:0:(import.c:65:import_set_state_nolock()) ffff8f0d874c4800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790740501.859165:0:14349:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d88286450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:752c79c8-24e4-410a-832f-aac51b94c085+5:3302:x1877727158292352:12345-0@lo:250:mount.lustre.0 Request processed in 289us (7455us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740501.859173:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790740501.859889:0:3302:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.158@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1790740501.859899:0:3302:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.158@tcp: connect to target with instance 0 00000100:00080000:0.0:1790740501.859906:0:3302:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.158@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1790740501.859911:0:3302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1790740501.859915:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8f0dbeb5a000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1790740501.859926:0:3302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1790740501.859935:0:3302:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1790740501.859942:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd7d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:752c79c8-24e4-410a-832f-aac51b94c085:3302:1877727158292352:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1790740501.870811:0:14338:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790740501.871075:0:14338:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1790740501.871082:0:14338:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1790740501.872321:0:14338:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1790740501.872335:0:14338:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1790740501.873030:0:14338:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1790740501.873038:0:14338:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1790740501.873746:0:14338:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790740501.873912:0:14338:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1790740501.873917:0:14338:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1790740501.874388:0:14338:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1790740501.874395:0:14338:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1790740501.930292:0:14338:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790740501.930539:0:14338:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1790740501.930546:0:14338:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1790740501.932467:0:14338:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1790740501.932478:0:14338:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1790740501.933519:0:14338:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790740501.933857:0:14338:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1790740501.933863:0:14338:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1790740501.934537:0:14338:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790740501.934545:0:14338:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1790740501.935553:0:14338:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790740501.935884:0:14338:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1790740501.935890:0:14338:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1790740501.936917:0:14338:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790740501.936926:0:14338:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1790740501.937893:0:14338:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790740501.938260:0:14338:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1790740501.938266:0:14338:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1790740501.938914:0:14338:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790740501.938921:0:14338:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1790740501.963477:0:14338:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790740501.964390:0:14338:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1790740501.964397:0:14338:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1790740501.966886:0:14338:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1790740501.966900:0:14338:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1790740501.967974:0:14338:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1790740501.967984:0:14338:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1790740501.981614:0:14338:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1790740501.981653:0:14338:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1790740501.981660:0:14338:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.158@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1790740501.981786:0:14338:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.158@tcp ctxt 0 is initialized 00000020:01000004:1.0:1790740501.981825:0:14338:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.158@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1790740501.981830:0:14338:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1790740501.981831:0:14338:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790740501.981832:0:14338:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790740501.981834:0:14338:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790740501.981835:0:14338:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790740501.981836:0:14338:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790740501.981838:0:14338:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790740501.981839:0:14338:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790740501.981841:0:14338:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790740501.981842:0:14338:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790740501.981845:0:14338:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1790740501.981847:0:14338:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790740501.981849:0:14338:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790740501.981850:0:14338:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790740501.981851:0:14338:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790740501.981852:0:14338:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790740501.981853:0:14338:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790740501.981854:0:14338:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790740501.981855:0:14338:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790740501.981856:0:14338:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790740501.981857:0:14338:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790740501.981882:0:14338:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1790740501.981903:0:14338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda77800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:14338:1877727158292480:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1790740501.981977:0:14338:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740501.982049:0:14338:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d83f7e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790740501.982284:0:14351:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158292480 00000100:00100000:2.0:1790740501.982291:0:14351:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158292480 00000100:00100000:2.0:1790740501.982339:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790740501.982349:0:14351:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8747dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:752c79c8-24e4-410a-832f-aac51b94c085+5:14338:x1877727158292480:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1790740501.982400:0:14351:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1790740501.982403:0:14351:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1790740501.982406:0:14351:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1790740501.983280:0:14372:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1790740501.983712:0:14351:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:2.0:1790740501.984915:0:14373:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1790740501.984921:0:14373:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1790740501.984931:0:14373:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1790740501.984982:0:14373:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1790740501.985509:0:14351:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1790740501.985519:0:14351:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1790740502.009512:0:14351:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8747dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:752c79c8-24e4-410a-832f-aac51b94c085+5:14338:x1877727158292480:12345-0@lo:253:mount.lustre.0 Request processed in 27156us (27527us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740502.009532:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790740502.009766:0:14338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda77800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:14338:1877727158292480:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1790740502.009784:0:14338:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1790740502.009788:0:14338:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790740502.009789:0:14338:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790740502.009791:0:14338:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790740502.009792:0:14338:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790740502.009793:0:14338:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790740502.009795:0:14338:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790740502.009796:0:14338:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790740502.009797:0:14338:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790740502.009812:0:14338:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790740502.009814:0:14338:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1790740502.009854:0:14338:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8f0c86750000 from lustre-MDT0000 10000000:01000000:3.0:1790740502.009880:0:14338:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1790740502.009884:0:14338:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1790740502.009888:0:14338:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8f0db5a719c0 10000000:01000000:3.0:1790740502.009893:0:14338:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790740502.009900:0:14338:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8f0db5a719c0 from 1 10000000:01000000:3.0:1790740502.009903:0:14338:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1790740502.009943:0:14338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0f200/0xc6b31a1b598eac24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740502.009954:0:14338:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0f200/0xc6b31a1b598eac24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740502.009965:0:14338:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0f200/0xc6b31a1b598eac24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740502.009984:0:14338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db57a8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:14338:1877727158292608:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790740502.010019:0:14338:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740502.010075:0:14338:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d83604d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790740502.010377:0:14350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158292608 00000100:00100000:2.0:1790740502.010385:0:14350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158292608 00000100:00100000:2.0:1790740502.010430:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790740502.010440:0:14350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8747e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+5:14338:x1877727158292608:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790740502.010453:0:14350:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740502.010467:0:14350:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0d87595200/0xc6b31a1b598eac2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b31a1b598eac24 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740502.010489:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0d87595200/0xc6b31a1b598eac2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b31a1b598eac24 expref: 6 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740502.010499:0:14350:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0d87595200/0xc6b31a1b598eac2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598eac24 expref: 6 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740502.010507:0:14350:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d87595200, rc 0) 00000100:00100000:2.0:1790740502.010553:0:14350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8747e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+6:14338:x1877727158292608:12345-0@lo:101:mount.lustre.0 Request processed in 115us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740502.010569:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790740502.010668:0:14338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db57a8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:14338:1877727158292608:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790740502.010681:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0f200/0xc6b31a1b598eac24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598eac2b expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740502.010691:0:14338:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0f200/0xc6b31a1b598eac24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598eac2b expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740502.010742:0:14338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1b43b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:14338:1877727158292736:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790740502.010767:0:14338:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740502.010806:0:14338:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d98727cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790740502.010969:0:14351:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158292736 00000100:00100000:1.0:1790740502.010974:0:14351:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158292736 00000100:00100000:1.0:1790740502.011010:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790740502.011017:0:14351:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8747c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:752c79c8-24e4-410a-832f-aac51b94c085+6:14338:x1877727158292736:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790740502.011458:0:14351:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8747c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:752c79c8-24e4-410a-832f-aac51b94c085+6:14338:x1877727158292736:12345-0@lo:501:mount.lustre.0 Request processed in 440us (688us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790740502.011466:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790740502.012386:0:14338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1b43b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:14338:1877727158292736:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1790740502.012421:0:14338:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.158@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1790740502.012450:0:14338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0f200/0xc6b31a1b598eac24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598eac2b expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740502.012461:0:14338:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0f200/0xc6b31a1b598eac24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598eac2b expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740502.012470:0:14338:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f0c86750000 10000000:01000000:0.0:1790740502.012475:0:14338:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1790740502.012479:0:14338:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8f0c86750000 10000000:01000000:0.0:1790740502.012490:0:14338:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1790740502.012494:0:14338:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8f0c86750000 from 1 10000000:01000000:0.0:1790740502.012496:0:14338:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1790740502.012523:0:14338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0dc132fc00/0xc6b31a1b598eac32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740502.012531:0:14338:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.158@tcp lock: ffff8f0dc132fc00/0xc6b31a1b598eac32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740502.012542:0:14338:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.158@tcp lock: ffff8f0dc132fc00/0xc6b31a1b598eac32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740502.012569:0:14338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1b43b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:14338:1877727158292864:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790740502.012624:0:14338:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740502.012668:0:14338:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d98727cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790740502.013439:0:14351:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158292864 00000100:00100000:2.0:1790740502.013448:0:14351:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158292864 00000100:00100000:2.0:1790740502.013499:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790740502.013509:0:14351:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8747c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:752c79c8-24e4-410a-832f-aac51b94c085+6:14338:x1877727158292864:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790740502.013522:0:14351:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740502.013538:0:14351:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0d87594600/0xc6b31a1b598eac39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b31a1b598eac32 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740502.013587:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0d87594600/0xc6b31a1b598eac39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b31a1b598eac32 expref: 7 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740502.013611:0:14351:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0d87594600/0xc6b31a1b598eac39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598eac32 expref: 7 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740502.013621:0:14351:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d87594600, rc 0) 00000100:00100000:2.0:1790740502.013678:0:14351:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8747c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:752c79c8-24e4-410a-832f-aac51b94c085+7:14338:x1877727158292864:12345-0@lo:101:mount.lustre.0 Request processed in 170us (1052us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740502.013685:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790740502.013745:0:14338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1b43b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:14338:1877727158292864:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790740502.013761:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.158@tcp lock: ffff8f0dc132fc00/0xc6b31a1b598eac32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598eac39 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740502.013770:0:14338:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.158@tcp lock: ffff8f0dc132fc00/0xc6b31a1b598eac32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598eac39 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740502.013784:0:14338:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.158@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1790740502.013797:0:14338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0dc132fc00/0xc6b31a1b598eac32 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598eac39 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740502.013804:0:14338:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.158@tcp lock: ffff8f0dc132fc00/0xc6b31a1b598eac32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598eac39 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740502.013812:0:14338:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1790740502.013828:0:14338:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790740502.013833:0:14338:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8f0c86750000 10000000:01000000:0.0:1790740502.013835:0:14338:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1790740502.013839:0:14338:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1790740502.013847:0:14338:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1790740502.013864:0:14338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0dc132fa00/0xc6b31a1b598eac40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740502.013872:0:14338:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.158@tcp lock: ffff8f0dc132fa00/0xc6b31a1b598eac40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740502.013880:0:14338:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.158@tcp lock: ffff8f0dc132fa00/0xc6b31a1b598eac40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740502.013892:0:14338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1b43b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:14338:1877727158292992:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790740502.013918:0:14338:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740502.013955:0:14338:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d98727cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790740502.014809:0:14350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158292992 00000100:00100000:2.0:1790740502.014819:0:14350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158292992 00000100:00100000:2.0:1790740502.014867:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790740502.014876:0:14350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8747e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+7:14338:x1877727158292992:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790740502.014887:0:14350:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740502.014900:0:14350:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0d87595a00/0xc6b31a1b598eac47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b31a1b598eac40 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740502.014919:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0d87595a00/0xc6b31a1b598eac47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b31a1b598eac40 expref: 8 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740502.014927:0:14350:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0d87595a00/0xc6b31a1b598eac47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598eac40 expref: 8 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740502.014934:0:14350:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d87595a00, rc 0) 00000100:00100000:2.0:1790740502.014987:0:14350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8747e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+8:14338:x1877727158292992:12345-0@lo:101:mount.lustre.0 Request processed in 112us (1067us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740502.014994:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790740502.015156:0:14338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1b43b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:14338:1877727158292992:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790740502.015170:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.158@tcp lock: ffff8f0dc132fa00/0xc6b31a1b598eac40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598eac47 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740502.015179:0:14338:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.158@tcp lock: ffff8f0dc132fa00/0xc6b31a1b598eac40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598eac47 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740502.015241:0:14338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db57ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:14338:1877727158293120:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790740502.015271:0:14338:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740502.015333:0:14338:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d83604d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790740502.015505:0:14349:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158293120 00000100:00100000:2.0:1790740502.015510:0:14349:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158293120 00000100:00100000:2.0:1790740502.015544:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790740502.015550:0:14349:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8747c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:752c79c8-24e4-410a-832f-aac51b94c085+8:14338:x1877727158293120:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790740502.015947:0:14349:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8747c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:752c79c8-24e4-410a-832f-aac51b94c085+9:14338:x1877727158293120:12345-0@lo:501:mount.lustre.0 Request processed in 396us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740502.015956:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790740502.015989:0:14338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db57ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:14338:1877727158293120:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790740502.016029:0:14338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1b40e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:14338:1877727158293248:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790740502.016070:0:14338:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740502.016110:0:14338:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d98727480 going to sleep for 11 seconds 00000100:00100000:2.0:1790740502.016259:0:14349:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158293248 00000100:00100000:2.0:1790740502.016265:0:14349:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158293248 00000100:00100000:2.0:1790740502.016297:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790740502.016303:0:14349:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8747d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:752c79c8-24e4-410a-832f-aac51b94c085+9:14338:x1877727158293248:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790740502.016640:0:14349:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8747d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:752c79c8-24e4-410a-832f-aac51b94c085+9:14338:x1877727158293248:12345-0@lo:503:mount.lustre.0 Request processed in 335us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740502.016647:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790740502.016819:0:14338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1b40e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:14338:1877727158293248:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790740502.017333:0:14374:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db57aa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:752c79c8-24e4-410a-832f-aac51b94c085:14374:1877727158293376:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790740502.017378:0:14374:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740502.017423:0:14374:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d83f7e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790740502.017515:0:14349:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158293376 00000100:00100000:2.0:1790740502.017521:0:14349:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158293376 00000100:00100000:2.0:1790740502.017555:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790740502.017602:0:14349:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8747d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:752c79c8-24e4-410a-832f-aac51b94c085+9:14374:x1877727158293376:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790740502.017849:0:14349:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8747d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:752c79c8-24e4-410a-832f-aac51b94c085+9:14374:x1877727158293376:12345-0@lo:502:llog_process_th.0 Request processed in 277us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740502.017856:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790740502.017937:0:14374:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db57aa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:752c79c8-24e4-410a-832f-aac51b94c085:14374:1877727158293376:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790740502.017971:0:14374:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790740502.017982:0:14374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790740502.017984:0:14374:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1790740502.017991:0:14374:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1790740502.017994:0:14374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790740502.018010:0:14374:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8f0d87f419c0) 00000020:00000080:3.0:1790740502.018026:0:14374:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1790740502.018040:0:14374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1790740502.018107:0:14374:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1790740502.018321:0:14374:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc6b31a1b598eac55 00000020:00000080:3.0:1790740502.018603:0:14374:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1790740502.018609:0:14374:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790740502.018613:0:14374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790740502.018615:0:14374:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1790740502.018618:0:14374:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790740502.018622:0:14374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790740502.018623:0:14374:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1790740502.018626:0:14374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790740502.018635:0:14374:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8f0d87f43380) 00000020:00000080:3.0:1790740502.018646:0:14374:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1790740502.018650:0:14374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1790740502.018652:0:14374:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1790740502.018655:0:14374:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1790740502.018660:0:14374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1790740502.018703:0:14374:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f0c86750000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1790740502.018714:0:14374:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8f0d87f44d40) 00000020:00000080:3.0:1790740502.018731:0:14374:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1790740502.018781:0:14374:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1790740502.018788:0:14374:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc6b31a1b598eac6a 00000020:00000080:3.0:1790740502.018886:0:14374:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1790740502.018892:0:14374:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1790740502.018896:0:14374:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xc6b31a1b598eac71 00080000:01000000:3.0:1790740502.018901:0:14374:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1790740502.018904:0:14374:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc6b31a1b598eac78 00010000:00010000:2.0:1790740502.116881:0:14374:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1790740502.117777:0:14374:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967527 00000001:00080000:0.0:1790740502.118000:0:14374:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1790740502.118732:0:14374:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8f0db6d7cd40) 00000020:00000080:0.0:1790740502.118752:0:14374:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1790740502.118827:0:14374:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:0.0:1790740502.118835:0:14374:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc6b31a1b598eac86 00000020:00000080:1.0:1790740502.124272:0:14374:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1790740502.127333:0:14374:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xc6b31a1b598eac8d 00000020:00000080:1.0:1790740502.133371:0:14374:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1790740502.133387:0:14374:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790740502.133396:0:14374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740502.133399:0:14374:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1790740502.133403:0:14374:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1790740502.133406:0:14374:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1790740502.133407:0:14374:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790740502.133409:0:14374:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790740502.133410:0:14374:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1790740502.133413:0:14374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740502.133414:0:14374:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1790740502.133417:0:14374:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790740502.133421:0:14374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740502.133423:0:14374:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1790740502.133429:0:14374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1790740502.133472:0:14374:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1790740502.133488:0:14374:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790740502.133491:0:14374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740502.133502:0:14374:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1790740502.133505:0:14374:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790740502.133509:0:14374:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1790740502.133512:0:14374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740502.133514:0:14374:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1790740502.133517:0:14374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1790740502.133522:0:14374:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.158@tcp to nid 0x20000c0a8cb9e (192.168.203.158@tcp) 00000020:01000000:1.0:1790740502.133545:0:14374:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1790740502.133549:0:14374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790740502.133594:0:14374:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8f0db5a74d40) 00000020:00000080:1.0:1790740502.133614:0:14374:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1790740502.133619:0:14374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1790740502.133674:0:14374:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1790740502.133679:0:14374:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1790740502.133685:0:14374:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc6b31a1b598eac9b 00010000:00080000:1.0:1790740502.133711:0:14374:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f0d90bfa800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.158@tcp at head 00010000:00010000:1.0:1790740502.133930:0:14374:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1790740502.134293:0:14374:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1790740502.134334:0:14374:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1790740502.135240:0:14374:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790740502.135300:0:14374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1790740502.135370:0:14374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1790740502.136409:0:14378:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1790740502.136413:0:14378:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1790740502.137890:0:14374:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790740502.137904:0:14374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1790740502.137936:0:14374:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1790740502.137954:0:14374:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc6b31a1b598eaca2 00000100:00080000:1.0:1790740502.139435:0:14374:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790740502.139450:0:14374:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8f0d90bfa800 using connection 192.168.203.158@tcp/0@lo 00000100:00100000:1.0:1790740502.139493:0:14374:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f0dbda75c00 x1877727158293504/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790740502.139543:0:14374:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1790740502.139699:0:14374:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790740502.139705:0:14374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740502.139707:0:14374:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1790740502.139710:0:14374:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1790740502.139713:0:14374:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:1.0:1790740502.139714:0:14374:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790740502.139716:0:14374:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790740502.139717:0:14374:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1790740502.139720:0:14374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740502.139721:0:14374:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:1.0:1790740502.139724:0:14374:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790740502.139728:0:14374:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1790740502.139730:0:14374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740502.139732:0:14374:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1790740502.139734:0:14374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1790740502.139738:0:14374:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.158@tcp to nid 0x20000c0a8cb9e (192.168.203.158@tcp) 00000020:01000000:1.0:1790740502.139758:0:14374:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1790740502.139760:0:14374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790740502.139773:0:14374:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8f0db5a70000) 00000020:00000080:1.0:1790740502.139788:0:14374:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1790740502.139792:0:14374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1790740502.139873:0:14374:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1790740502.139879:0:14374:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:1.0:1790740502.139886:0:14374:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc6b31a1b598eacb0 00010000:00080000:1.0:1790740502.139923:0:14374:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f0d83eed000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.158@tcp at head 00010000:00010000:1.0:1790740502.140144:0:14374:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000100:00100000:2.0:1790740502.140380:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1877727158293504:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1790740502.140431:0:3302:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877727158293504 offset 0 length 520: 4 00000040:01000000:1.0:1790740502.140854:0:14374:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1790740502.140877:0:14374:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1790740502.141916:0:14374:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790740502.142008:0:14374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1790740502.142095:0:14374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:2.0:1790740502.142811:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db57aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:752c79c8-24e4-410a-832f-aac51b94c085:3306:1877727158293632:0@lo:400:kworker.0 00000100:00100000:2.0:1790740502.142872:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740502.142979:0:14350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158293632 00000100:00100000:3.0:1790740502.142987:0:14350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158293632 00000100:00100000:3.0:1790740502.143035:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790740502.143045:0:14350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8747f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+9:3306:x1877727158293632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740502.143101:0:14350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8747f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+9:3306:x1877727158293632:12345-0@lo:400:kworker.0 Request processed in 57us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740502.143109:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790740502.143159:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db57aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:752c79c8-24e4-410a-832f-aac51b94c085:3306:1877727158293632:0@lo:400:kworker.0 00000040:00080000:1.0:1790740502.143528:0:14380:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1790740502.143533:0:14380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1790740502.144552:0:14374:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790740502.144612:0:14374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1790740502.144646:0:14374:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1790740502.144665:0:14374:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc6b31a1b598eacb7 00000100:00080000:0.0:1790740502.144673:0:14374:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790740502.144682:0:14374:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8f0d83eed000 using connection 192.168.203.158@tcp/0@lo 00000100:00100000:0.0:1790740502.144713:0:14374:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f0dc1b40e00 x1877727158293760/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790740502.144739:0:14374:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1790740502.144788:0:14374:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790740502.144793:0:14374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740502.144794:0:14374:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1790740502.144797:0:14374:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790740502.144801:0:14374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740502.144803:0:14374:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790740502.144806:0:14374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790740502.144808:0:14374:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1790740502.144810:0:14374:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790740502.144812:0:14374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740502.144814:0:14374:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:0.0:1790740502.144816:0:14374:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790740502.144819:0:14374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740502.144820:0:14374:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1790740502.144824:0:14374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1790740502.144856:0:14374:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1b43480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:752c79c8-24e4-410a-832f-aac51b94c085:14374:1877727158293888:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790740502.144915:0:14374:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740502.145269:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1b40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1877727158293760:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1790740502.145311:0:3302:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877727158293760 offset 0 length 520: 4 00000100:00100000:0.0:1790740502.145480:0:14374:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d987276c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790740502.145608:0:14351:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158293888 00000100:00100000:1.0:1790740502.145616:0:14351:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158293888 00000100:00100000:1.0:1790740502.145654:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790740502.145663:0:14351:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8747f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:752c79c8-24e4-410a-832f-aac51b94c085+9:14374:x1877727158293888:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790740502.145884:0:14351:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8747f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:752c79c8-24e4-410a-832f-aac51b94c085+9:14374:x1877727158293888:12345-0@lo:502:llog_process_th.0 Request processed in 222us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740502.145892:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790740502.146404:0:14374:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1b43480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:752c79c8-24e4-410a-832f-aac51b94c085:14374:1877727158293888:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790740502.146434:0:14374:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790740502.146440:0:14374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790740502.146449:0:14374:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1790740502.146453:0:14374:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1790740502.146823:0:14338:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1790740502.146842:0:14338:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.158@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1790740502.146863:0:14338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0dc132fa00/0xc6b31a1b598eac40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598eac47 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740502.146874:0:14338:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.158@tcp lock: ffff8f0dc132fa00/0xc6b31a1b598eac40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598eac47 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740502.146882:0:14338:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f0c86750000 from 1 10000000:01000000:3.0:1790740502.146884:0:14338:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790740502.146925:0:14338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0f000/0xc6b31a1b598eacbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740502.146940:0:14338:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0f000/0xc6b31a1b598eacbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740502.146949:0:14338:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0f000/0xc6b31a1b598eacbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740502.146967:0:14338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db57aa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:14338:1877727158294016:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790740502.147006:0:14338:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740502.147050:0:14338:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d9921bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1790740502.147050:0:14349:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158294016 00000100:00100000:2.0:1790740502.147062:0:14349:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158294016 00000100:00100000:2.0:1790740502.147103:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790740502.147110:0:14349:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8747d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:752c79c8-24e4-410a-832f-aac51b94c085+9:14338:x1877727158294016:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790740502.147131:0:14349:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740502.147144:0:14349:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0d87595000/0xc6b31a1b598eacc5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b31a1b598eacbe expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740502.147166:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0d87595000/0xc6b31a1b598eacc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b31a1b598eacbe expref: 10 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740502.147182:0:14349:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0d87595000/0xc6b31a1b598eacc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598eacbe expref: 10 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740502.147190:0:14349:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d87595000, rc 0) 00000100:00100000:2.0:1790740502.147232:0:14349:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8747d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:752c79c8-24e4-410a-832f-aac51b94c085+10:14338:x1877727158294016:12345-0@lo:101:mount.lustre.0 Request processed in 122us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740502.147238:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790740502.147377:0:14338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db57aa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:14338:1877727158294016:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790740502.147389:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0f000/0xc6b31a1b598eacbe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598eacc5 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740502.147398:0:14338:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0f000/0xc6b31a1b598eacbe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598eacc5 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740502.147986:0:14338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1b43480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:14338:1877727158294144:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1790740502.148023:0:14338:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740502.148049:0:14338:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d987276c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790740502.148158:0:14350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158294144 00000100:00100000:1.0:1790740502.148165:0:14350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158294144 00000100:00100000:1.0:1790740502.148206:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790740502.148213:0:14350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8747f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+10:14338:x1877727158294144:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1790740502.148228:0:14350:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1790740502.148233:0:14350:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1790740502.148297:0:14350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8747f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+10:14338:x1877727158294144:12345-0@lo:256:mount.lustre.0 Request processed in 84us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740502.148303:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790740502.148483:0:14338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1b43480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:14338:1877727158294144:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1790740502.149196:0:14338:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790740502.149218:0:14338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0f000/0xc6b31a1b598eacbe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598eacc5 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740502.149229:0:14338:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0f000/0xc6b31a1b598eacbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598eacc5 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740502.149237:0:14338:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f0c86750000 from 1 10000000:01000000:0.0:1790740502.149240:0:14338:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790740502.149328:0:14338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0dc132e200/0xc6b31a1b598eaccc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740502.149336:0:14338:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.158@tcp lock: ffff8f0dc132e200/0xc6b31a1b598eaccc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740502.149344:0:14338:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.158@tcp lock: ffff8f0dc132e200/0xc6b31a1b598eaccc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740502.152086:0:14338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1b43480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:14338:1877727158294272:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790740502.152213:0:14338:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740502.152386:0:14338:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d987276c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790740502.153467:0:14350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158294272 00000100:00100000:1.0:1790740502.153477:0:14350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158294272 00000100:00100000:1.0:1790740502.153532:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790740502.153542:0:14350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbe60dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+10:14338:x1877727158294272:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790740502.153569:0:14350:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740502.153704:0:14350:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0d9f977a00/0xc6b31a1b598eacd3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b31a1b598eaccc expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740502.153731:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0d9f977a00/0xc6b31a1b598eacd3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b31a1b598eaccc expref: 11 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740502.153755:0:14350:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0d9f977a00/0xc6b31a1b598eacd3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598eaccc expref: 11 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740502.153764:0:14350:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9f977a00, rc 0) 00000100:00100000:1.0:1790740502.153866:0:14350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbe60dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+11:14338:x1877727158294272:12345-0@lo:101:mount.lustre.0 Request processed in 325us (1653us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740502.153873:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790740502.154368:0:14338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1b43480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:14338:1877727158294272:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790740502.154388:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.158@tcp lock: ffff8f0dc132e200/0xc6b31a1b598eaccc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598eacd3 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740502.154399:0:14338:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.158@tcp lock: ffff8f0dc132e200/0xc6b31a1b598eaccc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598eacd3 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740502.154467:0:14338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1b43480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:14338:1877727158294400:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790740502.154502:0:14338:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740502.154760:0:14351:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158294400 00000100:00100000:3.0:1790740502.154767:0:14351:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158294400 00000100:00100000:1.0:1790740502.154833:0:14338:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d987276c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790740502.155076:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790740502.155086:0:14351:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbe60d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:752c79c8-24e4-410a-832f-aac51b94c085+11:14338:x1877727158294400:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790740502.155602:0:14351:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbe60d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:752c79c8-24e4-410a-832f-aac51b94c085+11:14338:x1877727158294400:12345-0@lo:501:mount.lustre.0 Request processed in 516us (1097us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740502.155610:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790740502.155685:0:14338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1b43480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:14338:1877727158294400:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790740502.155721:0:14338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db57a9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:14338:1877727158294528:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790740502.155762:0:14338:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740502.156002:0:14338:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d9921bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1790740502.156130:0:14349:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158294528 00000100:00100000:2.0:1790740502.156136:0:14349:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158294528 00000100:00100000:2.0:1790740502.156164:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790740502.156172:0:14349:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbe60e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:752c79c8-24e4-410a-832f-aac51b94c085+11:14338:x1877727158294528:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790740502.156412:0:14349:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbe60e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:752c79c8-24e4-410a-832f-aac51b94c085+11:14338:x1877727158294528:12345-0@lo:503:mount.lustre.0 Request processed in 240us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740502.156420:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790740502.156522:0:14338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db57a9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:14338:1877727158294528:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790740502.157151:0:14382:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db57a9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:752c79c8-24e4-410a-832f-aac51b94c085:14382:1877727158294656:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790740502.157192:0:14382:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740502.157231:0:14382:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d9921b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790740502.157334:0:14349:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158294656 00000100:00100000:2.0:1790740502.157340:0:14349:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158294656 00000100:00100000:2.0:1790740502.157373:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790740502.157380:0:14349:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbe60f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:752c79c8-24e4-410a-832f-aac51b94c085+11:14382:x1877727158294656:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790740502.157618:0:14349:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbe60f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:752c79c8-24e4-410a-832f-aac51b94c085+11:14382:x1877727158294656:12345-0@lo:502:llog_process_th.0 Request processed in 238us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740502.157625:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790740502.157769:0:14382:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db57a9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:752c79c8-24e4-410a-832f-aac51b94c085:14382:1877727158294656:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790740502.157793:0:14382:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790740502.157803:0:14382:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790740502.157806:0:14382:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1790740502.157813:0:14382:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f0c86750000 00000020:00000080:3.0:1790740502.157816:0:14382:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790740502.157830:0:14382:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790740502.157832:0:14382:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790740502.157834:0:14382:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1790740502.157836:0:14382:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790740502.157839:0:14382:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790740502.157840:0:14382:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1790740502.157843:0:14382:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f0c86750000 00000020:00000080:3.0:1790740502.157845:0:14382:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790740502.157892:0:14382:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790740502.157896:0:14382:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790740502.157898:0:14382:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1790740502.157900:0:14382:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790740502.157903:0:14382:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790740502.157904:0:14382:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790740502.157907:0:14382:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f0c86750000 00000020:00000080:3.0:1790740502.157908:0:14382:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1790740502.157946:0:14382:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db57a9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:752c79c8-24e4-410a-832f-aac51b94c085:14382:1877727158294784:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790740502.158044:0:14382:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740502.158080:0:14382:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d9921b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790740502.158122:0:14349:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158294784 00000100:00100000:2.0:1790740502.158127:0:14349:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158294784 00000100:00100000:2.0:1790740502.158162:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790740502.158169:0:14349:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbe60d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:752c79c8-24e4-410a-832f-aac51b94c085+11:14382:x1877727158294784:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790740502.158362:0:14349:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbe60d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:752c79c8-24e4-410a-832f-aac51b94c085+11:14382:x1877727158294784:12345-0@lo:502:llog_process_th.0 Request processed in 193us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740502.158369:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790740502.159399:0:14382:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db57a9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:752c79c8-24e4-410a-832f-aac51b94c085:14382:1877727158294784:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790740502.159429:0:14382:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790740502.159435:0:14382:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790740502.159437:0:14382:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1790740502.159443:0:14382:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1790740502.159648:0:14338:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1790740502.159669:0:14338:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790740502.159692:0:14338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0dc132e200/0xc6b31a1b598eaccc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598eacd3 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740502.159705:0:14338:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.158@tcp lock: ffff8f0dc132e200/0xc6b31a1b598eaccc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598eacd3 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790740502.159749:0:14338:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1790740502.159752:0:14338:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f0c86750000 10000000:01000000:2.0:1790740502.159755:0:14338:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f0c86750000 10000000:01000000:2.0:1790740502.159759:0:14338:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790740502.159765:0:14338:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f0c86750000 from 1 10000000:01000000:2.0:1790740502.159768:0:14338:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790740502.159796:0:14338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d87595800/0xc6b31a1b598eacda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740502.159804:0:14338:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.158@tcp lock: ffff8f0d87595800/0xc6b31a1b598eacda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740502.159819:0:14338:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.158@tcp lock: ffff8f0d87595800/0xc6b31a1b598eacda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740502.159839:0:14338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd7d6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:14338:1877727158294912:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790740502.159884:0:14338:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740502.159926:0:14338:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d9006aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1790740502.159943:0:14349:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158294912 00000100:00100000:2.0:1790740502.159948:0:14349:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158294912 00000100:00100000:2.0:1790740502.160047:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790740502.160056:0:14349:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbe60e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:752c79c8-24e4-410a-832f-aac51b94c085+11:14338:x1877727158294912:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790740502.160067:0:14349:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740502.160080:0:14349:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0d87594800/0xc6b31a1b598eace1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b31a1b598eacda expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740502.160114:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0d87594800/0xc6b31a1b598eace1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b31a1b598eacda expref: 12 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740502.160126:0:14349:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0d87594800/0xc6b31a1b598eace1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598eacda expref: 12 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740502.160135:0:14349:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d87594800, rc 0) 00000100:00100000:2.0:1790740502.160171:0:14349:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbe60e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:752c79c8-24e4-410a-832f-aac51b94c085+12:14338:x1877727158294912:12345-0@lo:101:mount.lustre.0 Request processed in 116us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740502.160177:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790740502.160214:0:14338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd7d6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:14338:1877727158294912:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790740502.160227:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.158@tcp lock: ffff8f0d87595800/0xc6b31a1b598eacda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598eace1 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740502.160242:0:14338:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.158@tcp lock: ffff8f0d87595800/0xc6b31a1b598eacda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598eace1 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740502.161402:0:14338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd7d6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:14338:1877727158295040:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790740502.161440:0:14338:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740502.161458:0:14338:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d9006aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1790740502.161477:0:14349:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158295040 00000100:00100000:2.0:1790740502.161482:0:14349:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158295040 00000100:00100000:2.0:1790740502.161506:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790740502.161512:0:14349:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbe60d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:752c79c8-24e4-410a-832f-aac51b94c085+12:14338:x1877727158295040:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790740502.161756:0:14349:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbe60d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:752c79c8-24e4-410a-832f-aac51b94c085+12:14338:x1877727158295040:12345-0@lo:501:mount.lustre.0 Request processed in 243us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740502.161764:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790740502.161799:0:14338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd7d6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:14338:1877727158295040:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790740502.161827:0:14338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd7d6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:14338:1877727158295168:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790740502.161863:0:14338:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740502.161876:0:14338:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d9006aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1790740502.161889:0:14349:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158295168 00000100:00100000:2.0:1790740502.161893:0:14349:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158295168 00000100:00100000:2.0:1790740502.161910:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790740502.161916:0:14349:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbe60f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:752c79c8-24e4-410a-832f-aac51b94c085+12:14338:x1877727158295168:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790740502.166547:0:14349:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbe60f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:752c79c8-24e4-410a-832f-aac51b94c085+12:14338:x1877727158295168:12345-0@lo:503:mount.lustre.0 Request processed in 4622us (4675us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740502.166587:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790740502.166676:0:14338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd7d6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:14338:1877727158295168:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790740502.173534:0:14384:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1b40a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:752c79c8-24e4-410a-832f-aac51b94c085:14384:1877727158295296:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790740502.173642:0:14384:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740502.173704:0:14384:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d987276c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790740502.174389:0:14351:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158295296 00000100:00100000:2.0:1790740502.174398:0:14351:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158295296 00000100:00100000:2.0:1790740502.174443:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790740502.174453:0:14351:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbe60c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:752c79c8-24e4-410a-832f-aac51b94c085+12:14384:x1877727158295296:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790740502.174744:0:14351:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbe60c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:752c79c8-24e4-410a-832f-aac51b94c085+12:14384:x1877727158295296:12345-0@lo:502:llog_process_th.0 Request processed in 291us (1101us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740502.174753:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790740502.175568:0:14384:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1b40a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:752c79c8-24e4-410a-832f-aac51b94c085:14384:1877727158295296:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1790740502.175648:0:14384:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1790740502.175663:0:14384:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8f0db6d7b380) 00000020:00000080:0.0:1790740502.175680:0:14384:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1790740502.176198:0:14384:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f0c86750000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1790740502.176203:0:14384:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f0c86750000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1790740502.176206:0:14384:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f0c86750000 4 00010000:00080000:0.0:1790740502.176234:0:14384:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f0dc1f26800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.158@tcp at head 00010000:00010000:0.0:1790740502.179486:0:14384:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:0.0:1790740502.181620:0:14384:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1790740502.181667:0:14384:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1790740502.181680:0:14384:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xc6b31a1b598eacef 00000100:00080000:0.0:1790740502.181692:0:14384:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790740502.181704:0:14384:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8f0dc1f26800 using connection 192.168.203.158@tcp/0@lo 00000100:00100000:0.0:1790740502.181738:0:14384:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f0dc1b40a80 x1877727158295424/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790740502.181781:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1b40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877727158295424:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1790740502.182091:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740502.182221:0:14356:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158295424 00000100:00100000:0.0:1790740502.182229:0:14356:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158295424 00000100:00100000:0.0:1790740502.182255:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790740502.182262:0:14356:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1b41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1877727158295424:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1790740502.182311:0:14356:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1b41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1877727158295424:12345-0@lo:38:llog_process_th.0 Request processed in 47us (220us total) trans 0 rc -11/-11 00000100:00100000:0.0:1790740502.182318:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790740502.182354:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790740502.182362:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8f0dc1f26800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790740502.182375:0:3302:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1790740502.182378:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1b40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877727158295424:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1790740502.182409:0:14384:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1790740502.184534:0:14384:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1b40a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:752c79c8-24e4-410a-832f-aac51b94c085:14384:1877727158295552:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790740502.184634:0:14384:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740502.184664:0:14350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158295552 00000100:00100000:0.0:1790740502.184671:0:14350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158295552 00000100:00100000:0.0:1790740502.184715:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790740502.184724:0:14350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbe60fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+12:14384:x1877727158295552:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790740502.185267:0:14350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbe60fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+12:14384:x1877727158295552:12345-0@lo:502:llog_process_th.0 Request processed in 542us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740502.185275:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790740502.185336:0:14384:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d987270c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790740502.185355:0:14384:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1b40a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:752c79c8-24e4-410a-832f-aac51b94c085:14384:1877727158295552:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1790740502.185379:0:14384:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1790740502.185499:0:14338:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1790740502.185522:0:14338:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790740502.185539:0:14338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d87595800/0xc6b31a1b598eacda lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598eace1 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740502.185550:0:14338:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.158@tcp lock: ffff8f0d87595800/0xc6b31a1b598eacda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598eace1 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1790740502.185622:0:14338:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1790740502.185625:0:14338:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790740502.185626:0:14338:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790740502.185628:0:14338:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790740502.185629:0:14338:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790740502.185630:0:14338:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790740502.185631:0:14338:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790740502.185633:0:14338:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790740502.185634:0:14338:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790740502.185636:0:14338:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790740502.185639:0:14338:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1790740502.185641:0:14338:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790740502.185642:0:14338:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790740502.185644:0:14338:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790740502.185645:0:14338:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790740502.185645:0:14338:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790740502.185651:0:14338:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790740502.185653:0:14338:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790740502.185654:0:14338:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790740502.185655:0:14338:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790740502.185655:0:14338:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790740502.185672:0:14338:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1790740502.185684:0:14338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd7d6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:14338:1877727158295680:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790740502.185716:0:14338:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740502.185741:0:14338:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d9006a300 going to sleep for 11 seconds 00000100:00100000:2.0:1790740502.185761:0:14349:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158295680 00000100:00100000:2.0:1790740502.185765:0:14349:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158295680 00000100:00100000:2.0:1790740502.185791:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790740502.185798:0:14349:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbe60ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:752c79c8-24e4-410a-832f-aac51b94c085+12:14338:x1877727158295680:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1790740502.185826:0:14349:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1790740502.185838:0:14349:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1790740502.215424:0:14349:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1790740502.215444:0:14349:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1790740502.216364:0:14372:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1790740502.216370:0:14372:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1790740502.216395:0:14372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f0db6c0ee00/0xc6b31a1b598eacf6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740502.216414:0:14372:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0d87595000/0xc6b31a1b598eacc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598eacbe expref: 12 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740502.216437:0:14372:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f0db6c0ee00/0xc6b31a1b598eacf6 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740502.216475:0:14372:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0d87595000/0xc6b31a1b598eacc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b31a1b598eacbe expref: 12 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740502.216490:0:14372:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f0d87595000/0xc6b31a1b598eacc5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b31a1b598eacbe expref: 12 pid: 14349 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740502.216504:0:14372:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db57a9180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14372:1877727158295808:0@lo:104: 00000100:00100000:3.0:1790740502.216601:0:14372:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740502.216655:0:14372:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d9921b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790740502.216695:0:14339:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158295808 00000100:00100000:3.0:1790740502.216702:0:14339:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158295808 00000100:00100000:3.0:1790740502.216750:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790740502.216759:0:14339:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db57ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:752c79c8-24e4-410a-832f-aac51b94c085+3:14372:x1877727158295808:12345-0@lo:104: 00010000:00010000:3.0:1790740502.216771:0:14339:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0f000/0xc6b31a1b598eacbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598eacc5 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740502.216825:0:14339:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790740502.216831:0:14339:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db57ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:752c79c8-24e4-410a-832f-aac51b94c085+3:14372:x1877727158295808:12345-0@lo:104: Request processed in 74us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740502.216838:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1790740502.216862:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740502.216868:0:14345:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0f000/0xc6b31a1b598eacbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598eacc5 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740502.216876:0:14345:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0f000 already unused, calling callback (ffffffffc1baec20) 10000000:00010000:3.0:1790740502.216886:0:14345:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0f000/0xc6b31a1b598eacbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b31a1b598eacc5 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740502.216895:0:14345:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0f000/0xc6b31a1b598eacbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b31a1b598eacc5 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790740502.216902:0:14345:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0f000/0xc6b31a1b598eacbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b31a1b598eacc5 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740502.216908:0:14345:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1790740502.216935:0:14345:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0f000/0xc6b31a1b598eacbe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598eacc5 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740502.216941:0:14345:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790740502.216960:0:14345:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0f000/0xc6b31a1b598eacbe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598eacc5 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740502.216967:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0f000/0xc6b31a1b598eacbe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598eacc5 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740502.216982:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740502.216985:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740502.216986:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740502.217013:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790740502.217022:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db57a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:752c79c8-24e4-410a-832f-aac51b94c085:3304:1877727158295936:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790740502.217052:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740502.217371:0:14341:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158295936 00000100:00100000:0.0:1790740502.217377:0:14341:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158295936 00010000:00010000:0.0:1790740502.217395:0:14341:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0d87595000/0xc6b31a1b598eacc5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598eacbe expref: 13 pid: 14349 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740502.217489:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790740502.217498:0:14341:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db57aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:752c79c8-24e4-410a-832f-aac51b94c085+13:3304:x1877727158295936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790740502.217509:0:14341:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740502.217514:0:14341:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0d87595000/0xc6b31a1b598eacc5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598eacbe expref: 13 pid: 14349 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740502.217524:0:14341:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0d87595000/0xc6b31a1b598eacc5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b31a1b598eacbe expref: 13 pid: 14349 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740502.217538:0:14341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f0db6c0ee00/0xc6b31a1b598eacf6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740502.217546:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0db6c0ee00/0xc6b31a1b598eacf6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790740502.217568:0:14341:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001198413s 00010000:00010000:0.0:1790740502.217652:0:14341:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f0db6c0ee00/0xc6b31a1b598eacf6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740502.217666:0:14341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f0db6c0ee00/0xc6b31a1b598eacf6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740502.217672:0:14341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f0db6c0ee00/0xc6b31a1b598eacf6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740502.217677:0:14341:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f0db6c0ee00/0xc6b31a1b598eacf6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740502.217682:0:14341:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0ee00 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:0.0:1790740502.217686:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f0db6c0ee00/0xc6b31a1b598eacf6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740502.217693:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f0db6c0ee00/0xc6b31a1b598eacf6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740502.217700:0:14341:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f0db6c0ee00/0xc6b31a1b598eacf6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740502.217709:0:14341:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740502.217748:0:14341:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db57aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:752c79c8-24e4-410a-832f-aac51b94c085+13:3304:x1877727158295936:12345-0@lo:103:ldlm_bl.0 Request processed in 252us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740502.217755:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1790740502.218415:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0d87595000/0xc6b31a1b598eacc5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b31a1b598eacbe expref: 12 pid: 14349 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740502.218426:0:14372:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db57a9180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14372:1877727158295808:0@lo:104: 00010000:00010000:2.0:1790740502.218443:0:14372:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f0db6c0ee00/0xc6b31a1b598eacf6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740502.218452:0:14372:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f0db6c0ee00/0xc6b31a1b598eacf6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740502.218459:0:14372:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f0db6c0ee00/0xc6b31a1b598eacf6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740502.218465:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0db6c0ee00/0xc6b31a1b598eacf6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740502.218633:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db57a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:752c79c8-24e4-410a-832f-aac51b94c085:3304:1877727158295936:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790740502.235673:0:14349:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbe60ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:752c79c8-24e4-410a-832f-aac51b94c085+11:14338:x1877727158295680:12345-0@lo:253:mount.lustre.0 Request processed in 49868us (49948us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740502.235687:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790740502.235855:0:14338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd7d6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:14338:1877727158295680:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790740502.235870:0:14338:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1790740502.235873:0:14338:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790740502.235875:0:14338:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790740502.235876:0:14338:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790740502.235877:0:14338:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790740502.235879:0:14338:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790740502.235880:0:14338:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790740502.235881:0:14338:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790740502.235883:0:14338:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790740502.235884:0:14338:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790740502.235886:0:14338:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1790740502.235899:0:14338:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1790740502.246004:0:14338:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1790740502.246357:0:14338:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1790740502.246947:0:14338:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1790740502.247371:0:14338:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1790740502.247926:0:14338:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1790740502.248480:0:14338:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1790740502.251244:0:14338:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1790740502.251506:0:14338:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1790740502.253220:0:14338:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1790740502.253551:0:14338:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1790740502.253928:0:14338:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1790740502.254218:0:14338:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:0.0:1790740502.280841:0:14338:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1790740502.281099:0:14338:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1790740502.281502:0:14396:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1790740502.281604:0:14396:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790740502.285009:0:14396:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1790740502.285076:0:14396:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1790740502.285091:0:14396:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:0.0:1790740502.285988:0:14338:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1790740502.286109:0:14338:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:1.0:1790740502.286875:0:14395:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1790740502.286880:0:14395:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000004:00000080:0.0:1790740502.287037:0:14338:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1790740502.287047:0:14338:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1790740502.287323:0:14338:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790740502.288672:0:14338:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1790740502.289202:0:14338:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1790740502.289233:0:14338:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1790740502.289744:0:14338:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:0.0:1790740502.290540:0:14338:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:0.0:1790740502.298916:0:14338:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1790740502.353859:0:14338:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1790740502.353898:0:14338:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa288818cf988 00100000:10000000:0.0:1790740502.353907:0:14338:0:(lfsck_lib.c:3084:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1790740502.354904:0:14338:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1790740502.354918:0:14338:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.158@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1790740502.354930:0:14338:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1790740502.354946:0:14338:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1790740502.834113:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1790740502.960656:0:14353:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1790740502.960664:0:14353:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f0c86750000 from 6 10000000:01000000:3.0:1790740502.960669:0:14353:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790740502.960712:0:14353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0f000/0xc6b31a1b598eacfd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740502.960725:0:14353:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0f000/0xc6b31a1b598eacfd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740502.960738:0:14353:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0f000/0xc6b31a1b598eacfd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740502.960763:0:14353:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db57a9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:752c79c8-24e4-410a-832f-aac51b94c085:14353:1877727158296064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790740502.960899:0:14353:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740502.961006:0:14353:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d863c86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790740502.963781:0:14350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158296064 00000100:00100000:0.0:1790740502.963794:0:14350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158296064 00000100:00100000:0.0:1790740502.963881:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790740502.963891:0:14350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbe60e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+11:14353:x1877727158296064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790740502.963909:0:14350:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740502.967646:0:14350:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0d9f976e00/0xc6b31a1b598ead04 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b31a1b598eacfd expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740502.967690:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0d9f976e00/0xc6b31a1b598ead04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b31a1b598eacfd expref: 12 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740502.967704:0:14350:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0d9f976e00/0xc6b31a1b598ead04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598eacfd expref: 12 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740502.967713:0:14350:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9f976e00, rc 0) 00000100:00100000:1.0:1790740502.967803:0:14350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbe60e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+12:14353:x1877727158296064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 3913us (6903us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740502.967823:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790740502.967905:0:14353:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db57a9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:752c79c8-24e4-410a-832f-aac51b94c085:14353:1877727158296064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790740502.967925:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0f000/0xc6b31a1b598eacfd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598ead04 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740502.967934:0:14353:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0f000/0xc6b31a1b598eacfd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598ead04 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740502.968007:0:14353:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd7d6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:752c79c8-24e4-410a-832f-aac51b94c085:14353:1877727158296192:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1790740502.968049:0:14353:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740502.968115:0:14353:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d985baf00 going to sleep for 11 seconds 00000100:00100000:1.0:1790740502.968763:0:14349:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158296192 00000100:00100000:1.0:1790740502.968772:0:14349:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158296192 00000100:00100000:1.0:1790740502.968839:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790740502.968856:0:14349:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbe60cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:752c79c8-24e4-410a-832f-aac51b94c085+12:14353:x1877727158296192:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1790740502.968888:0:14349:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1790740502.968914:0:14349:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790740502.968920:0:14349:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1790740502.969068:0:14349:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbe60cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:752c79c8-24e4-410a-832f-aac51b94c085+12:14353:x1877727158296192:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 221us (1018us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740502.969076:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790740502.969138:0:14353:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd7d6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:752c79c8-24e4-410a-832f-aac51b94c085:14353:1877727158296192:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1790740502.969214:0:14353:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790740502.969229:0:14353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0f000/0xc6b31a1b598eacfd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598ead04 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740502.969245:0:14353:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0f000/0xc6b31a1b598eacfd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598ead04 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790740503.220746:0:14391:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790740503.220757:0:14391:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790740503.221104:0:14391:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:1.0:1790740503.221111:0:14391:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1790740503.858059:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790740504.247767:0:14391:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790740504.247777:0:14391:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790740504.248282:0:14391:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1790740504.248344:0:14391:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790740504.248379:0:14391:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00010000:00010000:3.0:1790740504.880859:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740505.905086:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740506.929685:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790740507.361219:0:14639:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:2.0:1790740507.445273:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790740507.445279:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790740507.445282:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790740507.445292:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790740507.445295:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1790740507.445298:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1790740507.445301:0:8:0:(import.c:65:import_set_state_nolock()) ffff8f0dc1f26800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790740507.445316:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8f0dc1f26800 using connection 192.168.203.158@tcp/0@lo 00000100:00100000:2.0:1790740507.445341:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f0dbd7d4e00 x1877727158296448/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790740507.445381:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd7d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877727158296448:0@lo:38:kworker.0 00000100:00100000:2.0:1790740507.445448:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740507.445863:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd7d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:752c79c8-24e4-410a-832f-aac51b94c085:3304:1877727158296320:0@lo:400:kworker.0 00000100:00100000:0.0:1790740507.445911:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740507.448178:0:14358:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158296448 00000100:00100000:0.0:1790740507.448190:0:14358:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158296448 00000100:00100000:0.0:1790740507.448228:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790740507.448236:0:14358:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd7d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3302:x1877727158296448:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1790740507.448263:0:14358:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 423 last 0 00000020:00000080:0.0:1790740507.448305:0:14358:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xc6b31a1b598ead0b 00000004:00100000:0.0:1790740507.448322:0:14358:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790740507.448473:0:14358:0:(import.c:65:import_set_state_nolock()) ffff8f0d98c16800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790740507.448561:0:14358:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd7d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877727158296448:12345-0@lo:38:kworker.0 Request processed in 325us (3113us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740507.448569:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1790740507.449499:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8f0dbd7d4e00 x1877727158296448/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790740517 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790740507.449525:0:3302:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1790740507.449533:0:3302:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1790740507.449538:0:3302:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1790740507.449541:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8f0dc1f26800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790740507.449548:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd7d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877727158296448:0@lo:38:kworker.0 00000100:00100000:1.0:1790740507.450350:0:14350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158296320 00000100:00100000:1.0:1790740507.450359:0:14350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158296320 00000100:00100000:1.0:1790740507.450403:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790740507.450412:0:14350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbe60f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+12:3304:x1877727158296320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740507.450502:0:14350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbe60f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+12:3304:x1877727158296320:12345-0@lo:400:kworker.0 Request processed in 91us (4590us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740507.450510:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790740507.450565:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd7d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:752c79c8-24e4-410a-832f-aac51b94c085:3304:1877727158296320:0@lo:400:kworker.0 00010000:00010000:0.0:1790740507.952816:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740508.976755:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740510.001520:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1790740510.452314:0:14791:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe02812f90 20000000:00000080:0.0:1790740510.452332:0:14791:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f0d847b1c00 uarg=0000000000000000 20000000:01000000:0.0:1790740510.452389:0:14791:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1790740510.452396:0:14791:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1790740510.452400:0:14791:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1790740510.457091:0:14792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1790740510.457250:0:14791:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1790740510.475546:0:14791:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1790740510.475625:0:14791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f0dc132f800/0xc6b31a1b598ead12 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740510.475646:0:14791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0d9f977a00/0xc6b31a1b598eacd3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598eaccc expref: 11 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740510.475669:0:14791:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f0dc132f800/0xc6b31a1b598ead12 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740510.475710:0:14791:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0d9f977a00/0xc6b31a1b598eacd3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b31a1b598eaccc expref: 11 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740510.475724:0:14791:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f0d9f977a00/0xc6b31a1b598eacd3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b31a1b598eaccc expref: 11 pid: 14350 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740510.475740:0:14791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1b40a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14791:1877727158296576:0@lo:104: 00000100:00100000:0.0:1790740510.475800:0:14791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740510.475870:0:14791:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d848c50c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790740510.476142:0:14340:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158296576 00000100:00100000:3.0:1790740510.476151:0:14340:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158296576 00000100:00100000:3.0:1790740510.476197:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790740510.476207:0:14340:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1b42d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:752c79c8-24e4-410a-832f-aac51b94c085+3:14791:x1877727158296576:12345-0@lo:104: 00010000:00010000:3.0:1790740510.476220:0:14340:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.158@tcp lock: ffff8f0dc132e200/0xc6b31a1b598eaccc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598eacd3 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740510.476297:0:14340:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790740510.476303:0:14340:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1b42d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:752c79c8-24e4-410a-832f-aac51b94c085+3:14791:x1877727158296576:12345-0@lo:104: Request processed in 99us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740510.476310:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1790740510.476335:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740510.476340:0:14344:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.158@tcp lock: ffff8f0dc132e200/0xc6b31a1b598eaccc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598eacd3 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740510.476359:0:14344:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132e200 already unused, calling callback (ffffffffc1baec20) 10000000:00010000:3.0:1790740510.476363:0:14344:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.158@tcp lock: ffff8f0dc132e200/0xc6b31a1b598eaccc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b31a1b598eacd3 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740510.476371:0:14344:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.158@tcp lock: ffff8f0dc132e200/0xc6b31a1b598eaccc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b31a1b598eacd3 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790740510.476379:0:14344:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.158@tcp lock: ffff8f0dc132e200/0xc6b31a1b598eaccc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b31a1b598eacd3 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740510.476385:0:14344:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790740510.476414:0:14344:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.158@tcp lock: ffff8f0dc132e200/0xc6b31a1b598eaccc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598eacd3 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740510.476420:0:14344:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790740510.476436:0:14344:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.158@tcp lock: ffff8f0dc132e200/0xc6b31a1b598eaccc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598eacd3 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740510.476442:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.158@tcp lock: ffff8f0dc132e200/0xc6b31a1b598eaccc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598eacd3 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740510.476477:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740510.476479:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740510.476481:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740510.476511:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db57a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:752c79c8-24e4-410a-832f-aac51b94c085:3305:1877727158296704:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790740510.476539:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740510.476618:0:14341:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158296704 00000100:00100000:3.0:1790740510.476622:0:14341:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158296704 00010000:00010000:3.0:1790740510.476638:0:14341:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0d9f977a00/0xc6b31a1b598eacd3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598eaccc expref: 12 pid: 14350 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740510.476659:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790740510.476665:0:14341:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db57a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:752c79c8-24e4-410a-832f-aac51b94c085+12:3305:x1877727158296704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790740510.476675:0:14341:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740510.476680:0:14341:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0d9f977a00/0xc6b31a1b598eacd3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598eaccc expref: 12 pid: 14350 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740510.476690:0:14341:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0d9f977a00/0xc6b31a1b598eacd3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b31a1b598eaccc expref: 12 pid: 14350 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740510.476704:0:14341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f0dc132f800/0xc6b31a1b598ead12 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740510.476712:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0dc132f800/0xc6b31a1b598ead12 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740510.476737:0:14341:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f0dc132f800/0xc6b31a1b598ead12 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740510.476744:0:14341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f0dc132f800/0xc6b31a1b598ead12 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740510.476756:0:14341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f0dc132f800/0xc6b31a1b598ead12 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740510.476761:0:14341:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f0dc132f800/0xc6b31a1b598ead12 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740510.476766:0:14341:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132f800 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:3.0:1790740510.476769:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f0dc132f800/0xc6b31a1b598ead12 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740510.476777:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f0dc132f800/0xc6b31a1b598ead12 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740510.476786:0:14341:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f0dc132f800/0xc6b31a1b598ead12 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740510.476795:0:14341:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790740510.476824:0:14341:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db57a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:752c79c8-24e4-410a-832f-aac51b94c085+12:3305:x1877727158296704:12345-0@lo:103:ldlm_bl.0 Request processed in 159us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740510.476830:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790740510.476865:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db57a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:752c79c8-24e4-410a-832f-aac51b94c085:3305:1877727158296704:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790740510.477389:0:14791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0d9f977a00/0xc6b31a1b598eacd3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b31a1b598eaccc expref: 11 pid: 14350 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740510.477401:0:14791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1b40a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14791:1877727158296576:0@lo:104: 00010000:00010000:1.0:1790740510.477417:0:14791:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f0dc132f800/0xc6b31a1b598ead12 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740510.477425:0:14791:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f0dc132f800/0xc6b31a1b598ead12 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740510.477431:0:14791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f0dc132f800/0xc6b31a1b598ead12 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740510.477438:0:14791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0dc132f800/0xc6b31a1b598ead12 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740511.025163:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1790740512.048681:0:14353:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790740512.048689:0:14353:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f0c86750000 from 10 10000000:01000000:3.0:1790740512.048695:0:14353:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790740512.048839:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740512.048987:0:14353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0f400/0xc6b31a1b598ead19 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740512.049000:0:14353:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0f400/0xc6b31a1b598ead19 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740512.049199:0:14353:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0f400/0xc6b31a1b598ead19 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740512.049228:0:14353:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db57a9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:752c79c8-24e4-410a-832f-aac51b94c085:14353:1877727158296832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790740512.049294:0:14353:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740512.049419:0:14353:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d9923b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790740512.049530:0:14349:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158296832 00000100:00100000:1.0:1790740512.049540:0:14349:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158296832 00000100:00100000:1.0:1790740512.049627:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790740512.049645:0:14349:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbe60c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:752c79c8-24e4-410a-832f-aac51b94c085+11:14353:x1877727158296832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790740512.049658:0:14349:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740512.049671:0:14349:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0d9f977400/0xc6b31a1b598ead20 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b31a1b598ead19 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740512.049696:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0d9f977400/0xc6b31a1b598ead20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b31a1b598ead19 expref: 12 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740512.049708:0:14349:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0d9f977400/0xc6b31a1b598ead20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598ead19 expref: 12 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740512.049718:0:14349:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9f977400, rc 0) 00000100:00100000:1.0:1790740512.049813:0:14349:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbe60c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:752c79c8-24e4-410a-832f-aac51b94c085+12:14353:x1877727158296832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 170us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740512.049821:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790740512.050018:0:14353:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db57a9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:752c79c8-24e4-410a-832f-aac51b94c085:14353:1877727158296832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790740512.050034:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0f400/0xc6b31a1b598ead19 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598ead20 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740512.050043:0:14353:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0f400/0xc6b31a1b598ead19 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598ead20 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740512.050106:0:14353:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db57a9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:752c79c8-24e4-410a-832f-aac51b94c085:14353:1877727158296960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790740512.050132:0:14353:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740512.050174:0:14353:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d9923b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790740512.050186:0:14351:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158296960 00000100:00100000:2.0:1790740512.050192:0:14351:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158296960 00000100:00100000:2.0:1790740512.050276:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790740512.050284:0:14351:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbe8f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:752c79c8-24e4-410a-832f-aac51b94c085+12:14353:x1877727158296960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790740512.050554:0:14351:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbe8f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:752c79c8-24e4-410a-832f-aac51b94c085+12:14353:x1877727158296960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 271us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740512.050563:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790740512.050715:0:14353:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db57a9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:752c79c8-24e4-410a-832f-aac51b94c085:14353:1877727158296960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790740512.050747:0:14353:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db57a9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:752c79c8-24e4-410a-832f-aac51b94c085:14353:1877727158297088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790740512.050786:0:14353:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740512.057206:0:14353:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d9923b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790740512.057773:0:14350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158297088 00000100:00100000:1.0:1790740512.057783:0:14350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158297088 00000100:00100000:1.0:1790740512.057903:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790740512.057981:0:14350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbe8f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+12:14353:x1877727158297088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790740512.059969:0:14350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbe8f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+12:14353:x1877727158297088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1984us (9174us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740512.059982:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790740512.060071:0:14353:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db57a9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:752c79c8-24e4-410a-832f-aac51b94c085:14353:1877727158297088:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1790740512.061377:0:14852:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1790740512.063464:0:14353:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1790740512.063507:0:14353:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790740512.063520:0:14353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0f400/0xc6b31a1b598ead19 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598ead20 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740512.063644:0:14353:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0f400/0xc6b31a1b598ead19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598ead20 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740512.560697:0:3302:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790740502/real 1790740502] req@ffff8f0dc1b40e00 x1877727158293760/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790740512 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740512.560723:0:3302:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f0dc1b40e00 x1877727158293760/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790740512 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740512.560734:0:3302:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790740502/real 1790740502] req@ffff8f0dbda75c00 x1877727158293504/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790740512 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740512.560745:0:3302:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f0dbda75c00 x1877727158293504/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790740512 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790740512.560761:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8f0d83eed000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790740512.560787:0:3302:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790740512.560790:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1b40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1877727158293760:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1790740512.560796:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8f0d90bfa800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790740512.560813:0:3302:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790740512.560816:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1877727158293504:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1790740512.561161:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790740512.561167:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1790740512.561170:0:38:0:(import.c:65:import_set_state_nolock()) ffff8f0d90bfa800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790740512.561174:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 418 00000100:00080000:1.0:1790740512.561186:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1790740512.561198:0:38:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8f0d90bfa800 using connection 192.168.203.158@tcp/0@lo 00000100:00100000:1.0:1790740512.561229:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f0dbda74a80 x1877727158297216/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790740512.561244:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790740512.561247:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1790740512.561249:0:38:0:(import.c:65:import_set_state_nolock()) ffff8f0d83eed000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790740512.561252:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 418 00000100:00080000:1.0:1790740512.561254:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1790740512.561258:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8f0d83eed000 using connection 192.168.203.158@tcp/0@lo 00000100:00100000:1.0:1790740512.561269:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f0dbda77b80 x1877727158297344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790740512.561397:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877727158297472:0@lo:400:kworker.0 00000100:00100000:0.0:1790740512.561456:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1877727158297216:0@lo:8:kworker.0 00000100:00100000:3.0:1790740512.561472:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000400:00000100:0.0:1790740512.561479:0:3302:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877727158297216 offset 0 length 520: 4 00000100:00100000:1.0:1790740512.561547:0:14357:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158297472 00000100:00100000:1.0:1790740512.561555:0:14357:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158297472 00000100:00100000:1.0:1790740512.561611:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790740512.561619:0:14357:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db57a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877727158297472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740512.562094:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1877727158297344:0@lo:8:kworker.0 00000400:00000100:0.0:1790740512.562127:0:3302:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877727158297344 offset 0 length 520: 4 00000100:00100000:1.0:1790740512.576283:0:14357:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db57a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877727158297472:12345-0@lo:400:kworker.0 Request processed in 14657us (14803us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740512.576298:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1790740512.576309:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8f0dbda75180 x1877727158297472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740528 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740512.576323:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877727158297472:0@lo:400:kworker.0 00010000:00010000:3.0:1790740513.073028:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740514.099387:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790740514.485343:0:14391:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790740515.123120:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1790740515.777771:0:15040:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1790740515.777775:0:15040:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1790740515.777896:0:15040:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8f0dbdaf3000 00000020:01000004:3.0:1790740515.777911:0:15040:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1790740515.777923:0:15040:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1790740515.777937:0:15040:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8f0d87f40000) 00000020:00000080:3.0:1790740515.777950:0:15040:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1790740515.804550:0:15040:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1790740515.805090:0:15040:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1790740515.806202:0:15040:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1790740515.806452:0:15040:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1790740515.806849:0:15040:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1790740515.807304:0:15040:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 425: rc = 0 00100000:10000000:2.0:1790740515.807395:0:15040:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 425: rc = 0 00100000:10000000:2.0:1790740515.807496:0:15040:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 425: rc = 0 00100000:10000000:2.0:1790740515.809099:0:15040:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 640: rc = 0 00100000:10000000:2.0:1790740515.809449:0:15040:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 640: rc = 0 00100000:10000000:2.0:1790740515.810100:0:15040:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 640: rc = 0 00100000:10000000:2.0:1790740515.810661:0:15040:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 640: rc = 0 00100000:10000000:2.0:1790740515.811104:0:15040:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 640: rc = 0 00100000:10000000:2.0:1790740515.811351:0:15040:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 640: rc = 0 00000020:00000080:2.0:1790740515.812102:0:15040:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1790740515.812112:0:15040:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790740515.812126:0:15040:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc6b31a1b598ead2e 00000020:01000004:2.0:1790740515.812133:0:15040:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1790740515.812153:0:15040:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.158@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1790740515.812156:0:15040:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.158@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1790740515.812162:0:15040:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1790740515.812166:0:15040:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1790740515.812177:0:15040:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8f0db6f5cd40) 00000020:00000080:2.0:1790740515.812187:0:15040:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1790740515.818141:0:15040:0:(service.c:173:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790740515.818315:0:15040:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1790740515.818320:0:15040:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1790740515.823780:0:15040:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1790740515.823793:0:15040:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1790740515.824881:0:15040:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1790740515.824889:0:15040:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1790740515.838854:0:15040:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790740515.840140:0:15040:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1790740515.840149:0:15040:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1790740515.845544:0:15040:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1790740515.845559:0:15040:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1790740515.890542:0:15040:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790740515.892116:0:15040:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1790740515.892123:0:15040:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1790740515.893707:0:15040:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1790740515.893725:0:15040:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1790740515.894611:0:15040:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1790740515.894619:0:15040:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1790740515.899256:0:15040:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790740515.899450:0:15040:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1790740515.899467:0:15040:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1790740515.906273:0:15040:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1790740515.906289:0:15040:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1790740515.982093:0:15040:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790740515.982293:0:15040:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1790740515.982299:0:15040:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1790740515.984173:0:15040:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1790740515.984186:0:15040:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1790740515.985246:0:15040:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1790740515.985272:0:15040:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1790740515.985284:0:15040:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.158@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1790740516.002548:0:15040:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.158@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790740516.002616:0:15040:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.158@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1790740516.002620:0:15040:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790740516.002622:0:15040:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790740516.002624:0:15040:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790740516.002625:0:15040:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790740516.002627:0:15040:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790740516.002628:0:15040:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790740516.002630:0:15040:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790740516.002632:0:15040:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790740516.002633:0:15040:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790740516.002640:0:15040:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1790740516.002642:0:15040:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790740516.002643:0:15040:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790740516.002644:0:15040:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790740516.002645:0:15040:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790740516.002646:0:15040:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790740516.002647:0:15040:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790740516.002648:0:15040:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790740516.002649:0:15040:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790740516.002650:0:15040:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790740516.002690:0:15040:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1790740516.002712:0:15040:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd7d4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15040:1877727158297600:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790740516.002781:0:15040:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740516.002845:0:15040:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0dc102c480 going to sleep for 11 seconds 00000100:00100000:0.0:1790740516.003007:0:14349:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158297600 00000100:00100000:0.0:1790740516.003016:0:14349:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158297600 00000100:00100000:0.0:1790740516.003064:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790740516.003073:0:14349:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbe8fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:752c79c8-24e4-410a-832f-aac51b94c085+12:15040:x1877727158297600:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790740516.003102:0:14349:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1790740516.003106:0:14349:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1790740516.003110:0:14349:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1790740516.020505:0:14349:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbe8fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:752c79c8-24e4-410a-832f-aac51b94c085+12:15040:x1877727158297600:12345-0@lo:253:mount.lustre.0 Request processed in 17425us (17715us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740516.020519:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790740516.020692:0:15040:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd7d4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15040:1877727158297600:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790740516.020707:0:15040:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1790740516.020711:0:15040:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790740516.020713:0:15040:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790740516.020714:0:15040:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790740516.020715:0:15040:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790740516.020717:0:15040:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790740516.020718:0:15040:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790740516.020719:0:15040:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790740516.020721:0:15040:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790740516.020737:0:15040:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1790740516.020760:0:15040:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8f0dbdaf3000 from lustre-OST0000 10000000:01000000:2.0:1790740516.020786:0:15040:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1790740516.020789:0:15040:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1790740516.020795:0:15040:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8f0db5a719c0 local copy 00010000:00010000:2.0:1790740516.020805:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0f200/0xc6b31a1b598eac24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598eac2b expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740516.027835:0:15040:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd7d4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15040:1877727158297728:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790740516.027903:0:15040:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740516.027961:0:15040:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0dc102ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1790740516.028091:0:14350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158297728 00000100:00100000:1.0:1790740516.028111:0:14350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158297728 00000100:00100000:1.0:1790740516.028160:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790740516.028169:0:14350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbe8f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+12:15040:x1877727158297728:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790740516.028393:0:14350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbe8f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+12:15040:x1877727158297728:12345-0@lo:501:mount.lustre.0 Request processed in 225us (489us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790740516.028401:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790740516.028537:0:15040:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd7d4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15040:1877727158297728:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1790740516.028556:0:15040:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.158@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1790740516.028736:0:15040:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.158@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1790740516.028745:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0f200/0xc6b31a1b598eac24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598eac2b expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740516.028757:0:15040:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0f200/0xc6b31a1b598eac24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598eac2b expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740516.028783:0:15040:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f0dbdaf3000 10000000:01000000:3.0:1790740516.028788:0:15040:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1790740516.028792:0:15040:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8f0db5a719c0 10000000:01000000:3.0:1790740516.028795:0:15040:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1790740516.028798:0:15040:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8f0db5a719c0 from 1 10000000:01000000:3.0:1790740516.028801:0:15040:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1790740516.028827:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0e200/0xc6b31a1b598ead3c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740516.028836:0:15040:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0e200/0xc6b31a1b598ead3c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740516.028845:0:15040:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0e200/0xc6b31a1b598ead3c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740516.028861:0:15040:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db57a9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15040:1877727158297856:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790740516.028892:0:15040:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740516.028931:0:15040:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d98d2fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1790740516.029002:0:14349:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158297856 00000100:00100000:0.0:1790740516.029008:0:14349:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158297856 00000100:00100000:0.0:1790740516.029040:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790740516.029056:0:14349:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbe8fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:752c79c8-24e4-410a-832f-aac51b94c085+12:15040:x1877727158297856:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790740516.029067:0:14349:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740516.029079:0:14349:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0dc132f000/0xc6b31a1b598ead43 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b31a1b598ead3c expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740516.029100:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0dc132f000/0xc6b31a1b598ead43 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b31a1b598ead3c expref: 13 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740516.029112:0:14349:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0dc132f000/0xc6b31a1b598ead43 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598ead3c expref: 13 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740516.029120:0:14349:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0dc132f000, rc 0) 00000100:00100000:0.0:1790740516.029160:0:14349:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbe8fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:752c79c8-24e4-410a-832f-aac51b94c085+13:15040:x1877727158297856:12345-0@lo:101:mount.lustre.0 Request processed in 105us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740516.029167:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790740516.029306:0:15040:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db57a9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15040:1877727158297856:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790740516.029328:0:15040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0e200/0xc6b31a1b598ead3c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598ead43 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740516.029337:0:15040:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0e200/0xc6b31a1b598ead3c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598ead43 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740516.029352:0:15040:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.158@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1790740516.029370:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0e200/0xc6b31a1b598ead3c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598ead43 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740516.029377:0:15040:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0e200/0xc6b31a1b598ead3c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598ead43 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740516.029383:0:15040:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1790740516.029387:0:15040:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790740516.029391:0:15040:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1790740516.029394:0:15040:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1790740516.029409:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0e600/0xc6b31a1b598ead4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740516.029416:0:15040:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0e600/0xc6b31a1b598ead4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740516.029424:0:15040:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0e600/0xc6b31a1b598ead4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740516.029438:0:15040:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db57a9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15040:1877727158297984:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790740516.029475:0:15040:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740516.029487:0:15040:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d98d2fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1790740516.029554:0:14350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158297984 00000100:00100000:1.0:1790740516.029559:0:14350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158297984 00000100:00100000:1.0:1790740516.029604:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790740516.029612:0:14350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbe8fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+13:15040:x1877727158297984:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790740516.029619:0:14350:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740516.029626:0:14350:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0d9f976c00/0xc6b31a1b598ead51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b31a1b598ead4a expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740516.029640:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0d9f976c00/0xc6b31a1b598ead51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b31a1b598ead4a expref: 14 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740516.029647:0:14350:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0d9f976c00/0xc6b31a1b598ead51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598ead4a expref: 14 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740516.029653:0:14350:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9f976c00, rc 0) 00000100:00100000:1.0:1790740516.029690:0:14350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbe8fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+14:15040:x1877727158297984:12345-0@lo:101:mount.lustre.0 Request processed in 79us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740516.029696:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790740516.029772:0:15040:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db57a9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15040:1877727158297984:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790740516.029785:0:15040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0e600/0xc6b31a1b598ead4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598ead51 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740516.029791:0:15040:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0e600/0xc6b31a1b598ead4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598ead51 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790740516.030406:0:15040:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1790740516.031276:0:15040:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790740516.031551:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1790740516.031640:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1790740516.031692:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1790740516.031745:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1790740516.031785:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1790740516.031821:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1790740516.031888:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1790740516.031896:0:15040:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1790740516.031972:0:15040:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db57a9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15040:1877727158298112:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790740516.032024:0:15040:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740516.032072:0:15040:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d98d2f000 going to sleep for 11 seconds 00000100:00100000:1.0:1790740516.032235:0:14350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158298112 00000100:00100000:1.0:1790740516.032243:0:14350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158298112 00000100:00100000:1.0:1790740516.032273:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790740516.032281:0:14350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbe8fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+14:15040:x1877727158298112:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790740516.032613:0:14350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbe8fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+14:15040:x1877727158298112:12345-0@lo:501:mount.lustre.0 Request processed in 331us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740516.032621:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790740516.035860:0:15040:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db57a9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15040:1877727158298112:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790740516.035922:0:15040:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db57a9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15040:1877727158298240:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790740516.036848:0:15040:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740516.036960:0:15040:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d98d2f000 going to sleep for 11 seconds 00000100:00100000:1.0:1790740516.042782:0:14350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158298240 00000100:00100000:1.0:1790740516.042797:0:14350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158298240 00000100:00100000:1.0:1790740516.043886:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790740516.043903:0:14350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbe8fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+14:15040:x1877727158298240:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790740516.044300:0:14350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbe8fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+14:15040:x1877727158298240:12345-0@lo:503:mount.lustre.0 Request processed in 403us (7453us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740516.044309:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790740516.044819:0:15040:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db57a9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15040:1877727158298240:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1790740516.045918:0:15040:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790740516.047378:0:15040:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db57a9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15040:1877727158298368:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790740516.047500:0:15040:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740516.048094:0:15040:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d98d2f000 going to sleep for 11 seconds 00000100:00100000:2.0:1790740516.048115:0:14351:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158298368 00000100:00100000:2.0:1790740516.048124:0:14351:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158298368 00000100:00100000:3.0:1790740516.048285:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790740516.048295:0:14351:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbe8fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:752c79c8-24e4-410a-832f-aac51b94c085+14:15040:x1877727158298368:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790740516.048886:0:14351:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbe8fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:752c79c8-24e4-410a-832f-aac51b94c085+14:15040:x1877727158298368:12345-0@lo:502:mount.lustre.0 Request processed in 592us (1395us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740516.048895:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790740516.048924:0:15040:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db57a9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15040:1877727158298368:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790740516.049416:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1790740516.049487:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1790740516.049662:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1790740516.049717:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1790740516.049882:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1790740516.049925:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1790740516.050111:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1790740516.050151:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1790740516.050188:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1790740516.050223:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1790740516.050241:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1790740516.050264:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1790740516.050297:0:15040:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1b40e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15040:1877727158298496:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790740516.050350:0:15040:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740516.050412:0:15040:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d985ba540 going to sleep for 11 seconds 00000100:00100000:2.0:1790740516.050488:0:14349:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158298496 00000100:00100000:2.0:1790740516.050494:0:14349:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158298496 00000100:00100000:2.0:1790740516.050603:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790740516.050614:0:14349:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbe8fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:752c79c8-24e4-410a-832f-aac51b94c085+14:15040:x1877727158298496:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790740516.050812:0:14349:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbe8fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:752c79c8-24e4-410a-832f-aac51b94c085+14:15040:x1877727158298496:12345-0@lo:502:mount.lustre.0 Request processed in 191us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740516.050821:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790740516.050912:0:15040:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1b40e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15040:1877727158298496:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790740516.050980:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1790740516.051112:0:15040:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1790740516.052147:0:15054:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790740516.052157:0:15054:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1790740516.052164:0:15054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740516.052166:0:15054:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1790740516.052172:0:15054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790740516.052186:0:15054:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8f0db5a73380) 00000020:00000080:1.0:1790740516.052206:0:15054:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1790740516.052211:0:15054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1790740516.052273:0:15054:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f0dbdaf3000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1790740516.052281:0:15054:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1790740516.052286:0:15054:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc6b31a1b598ead5f 00010000:00010000:0.0:1790740516.058257:0:15054:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:0.0:1790740516.058718:0:15054:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:0.0:1790740516.062000:0:15054:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1790740516.065048:0:15054:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1790740516.065060:0:15054:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790740516.065066:0:15054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790740516.065068:0:15054:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1790740516.065072:0:15054:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1790740516.065074:0:15054:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:3.0:1790740516.065076:0:15054:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790740516.065077:0:15054:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790740516.065078:0:15054:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1790740516.065081:0:15054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790740516.065082:0:15054:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:3.0:1790740516.065084:0:15054:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790740516.065087:0:15054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790740516.065089:0:15054:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790740516.065091:0:15054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790740516.065093:0:15054:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1790740516.065095:0:15054:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790740516.065097:0:15054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790740516.065099:0:15054:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:3.0:1790740516.065101:0:15054:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790740516.065103:0:15054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790740516.065104:0:15054:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1790740516.065108:0:15054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1790740516.065168:0:15054:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790740516.065172:0:15054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790740516.065180:0:15054:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1790740516.065184:0:15054:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1790740516.065424:0:15040:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1790740516.065448:0:15040:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.158@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1790740516.065479:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0e600/0xc6b31a1b598ead4a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598ead51 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740516.065491:0:15040:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0e600/0xc6b31a1b598ead4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598ead51 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740516.065499:0:15040:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f0dbdaf3000 from 1 10000000:01000000:0.0:1790740516.065502:0:15040:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790740516.065533:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0dc132fe00/0xc6b31a1b598ead66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740516.065541:0:15040:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.158@tcp lock: ffff8f0dc132fe00/0xc6b31a1b598ead66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740516.065551:0:15040:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.158@tcp lock: ffff8f0dc132fe00/0xc6b31a1b598ead66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740516.065599:0:15040:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1b40e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15040:1877727158298624:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790740516.065661:0:15040:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740516.065723:0:15040:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d985ba480 going to sleep for 11 seconds 00000100:00100000:1.0:1790740516.065860:0:14351:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158298624 00000100:00100000:1.0:1790740516.065867:0:14351:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158298624 00000100:00100000:1.0:1790740516.065913:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790740516.065922:0:14350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbe8f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+14:15040:x1877727158298624:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790740516.065934:0:14350:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740516.065947:0:14350:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0d9f976a00/0xc6b31a1b598ead6d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b31a1b598ead66 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740516.065980:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0d9f976a00/0xc6b31a1b598ead6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b31a1b598ead66 expref: 15 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740516.065991:0:14350:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0d9f976a00/0xc6b31a1b598ead6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598ead66 expref: 15 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740516.066000:0:14350:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9f976a00, rc 0) 00000100:00100000:1.0:1790740516.066038:0:14350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbe8f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+15:15040:x1877727158298624:12345-0@lo:101:mount.lustre.0 Request processed in 117us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740516.066046:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790740516.066140:0:15040:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1b40e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15040:1877727158298624:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790740516.066154:0:15040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.158@tcp lock: ffff8f0dc132fe00/0xc6b31a1b598ead66 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598ead6d expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740516.066163:0:15040:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.158@tcp lock: ffff8f0dc132fe00/0xc6b31a1b598ead66 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598ead6d expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790740516.066689:0:15040:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1790740516.066953:0:15040:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790740516.067201:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1790740516.067248:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1790740516.067312:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1790740516.067320:0:15040:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1790740516.067376:0:15040:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1b40e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15040:1877727158298752:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790740516.067426:0:15040:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740516.067485:0:15040:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d985ba480 going to sleep for 11 seconds 00000100:00100000:0.0:1790740516.067919:0:14349:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158298752 00000100:00100000:0.0:1790740516.067926:0:14349:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158298752 00000100:00100000:0.0:1790740516.068001:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790740516.068010:0:14349:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbe8f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:752c79c8-24e4-410a-832f-aac51b94c085+15:15040:x1877727158298752:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790740516.068230:0:14349:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbe8f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:752c79c8-24e4-410a-832f-aac51b94c085+15:15040:x1877727158298752:12345-0@lo:501:mount.lustre.0 Request processed in 220us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740516.068238:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790740516.069951:0:15040:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1b40e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15040:1877727158298752:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790740516.070007:0:15040:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db57aa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15040:1877727158298880:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790740516.070067:0:15040:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740516.070295:0:15040:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d98d2f240 going to sleep for 11 seconds 00000100:00100000:1.0:1790740516.073654:0:14350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158298880 00000100:00100000:1.0:1790740516.073667:0:14350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158298880 00000100:00100000:1.0:1790740516.073715:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790740516.073723:0:14350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8742e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+15:15040:x1877727158298880:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790740516.073947:0:14350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8742e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+15:15040:x1877727158298880:12345-0@lo:503:mount.lustre.0 Request processed in 224us (3880us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740516.073955:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790740516.074066:0:15040:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db57aa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15040:1877727158298880:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790740516.074644:0:15040:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790740516.074718:0:15040:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd7d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15040:1877727158299008:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790740516.074765:0:15040:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740516.074806:0:15040:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0dc102ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1790740516.074870:0:14350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158299008 00000100:00100000:1.0:1790740516.074875:0:14350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158299008 00000100:00100000:1.0:1790740516.074912:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1790740516.074920:0:14350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8742d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+15:15040:x1877727158299008:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790740516.075069:0:14350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8742d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+15:15040:x1877727158299008:12345-0@lo:502:mount.lustre.0 Request processed in 149us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740516.075077:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790740516.075158:0:15040:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd7d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15040:1877727158299008:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790740516.075385:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1790740516.075434:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1790740516.075510:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1790740516.075547:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1790740516.075623:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1790740516.075675:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1790740516.075712:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1790740516.075745:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1790740516.075773:0:15040:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd7d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15040:1877727158299136:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790740516.075813:0:15040:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740516.075843:0:15040:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0dc102ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1790740516.075871:0:14351:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158299136 00000100:00100000:2.0:1790740516.075876:0:14351:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158299136 00000100:00100000:2.0:1790740516.075899:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790740516.075905:0:14351:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8742f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:752c79c8-24e4-410a-832f-aac51b94c085+15:15040:x1877727158299136:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790740516.076037:0:14351:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8742f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:752c79c8-24e4-410a-832f-aac51b94c085+15:15040:x1877727158299136:12345-0@lo:502:mount.lustre.0 Request processed in 131us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740516.076044:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790740516.076079:0:15040:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd7d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15040:1877727158299136:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790740516.076147:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1790740516.076156:0:15040:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1790740516.078124:0:15058:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790740516.078137:0:15058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740516.078149:0:15058:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1790740516.078157:0:15058:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f0dbdaf3000 00000020:00000080:1.0:1790740516.078160:0:15058:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790740516.078167:0:15058:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790740516.078170:0:15058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740516.078171:0:15058:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1790740516.078174:0:15058:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790740516.078177:0:15058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740516.078178:0:15058:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1790740516.078182:0:15058:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f0dbdaf3000 00000020:00000080:1.0:1790740516.078184:0:15058:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790740516.078282:0:15058:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790740516.078287:0:15058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740516.078289:0:15058:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1790740516.078292:0:15058:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790740516.078295:0:15058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740516.078297:0:15058:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790740516.078300:0:15058:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f0dbdaf3000 00000020:00000080:1.0:1790740516.078303:0:15058:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790740516.079797:0:15058:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790740516.079805:0:15058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740516.079807:0:15058:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1790740516.079811:0:15058:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1790740516.092534:0:15040:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1790740516.092588:0:15040:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790740516.092604:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0dc132fe00/0xc6b31a1b598ead66 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598ead6d expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740516.092616:0:15040:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.158@tcp lock: ffff8f0dc132fe00/0xc6b31a1b598ead66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598ead6d expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790740516.092658:0:15040:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1790740516.092661:0:15040:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f0dbdaf3000 10000000:01000000:2.0:1790740516.092670:0:15040:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f0dbdaf3000 10000000:01000000:2.0:1790740516.092673:0:15040:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790740516.092679:0:15040:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f0dbdaf3000 from 1 10000000:01000000:2.0:1790740516.092682:0:15040:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790740516.092714:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d87594000/0xc6b31a1b598ead74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740516.092721:0:15040:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.158@tcp lock: ffff8f0d87594000/0xc6b31a1b598ead74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740516.092733:0:15040:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.158@tcp lock: ffff8f0d87594000/0xc6b31a1b598ead74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740516.092757:0:15040:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd7d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15040:1877727158299264:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790740516.092820:0:15040:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740516.092877:0:15040:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0dc102c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790740516.092907:0:14351:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158299264 00000100:00100000:2.0:1790740516.092913:0:14351:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158299264 00000100:00100000:2.0:1790740516.092959:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790740516.092970:0:14350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8742ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+15:15040:x1877727158299264:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790740516.092983:0:14350:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740516.092995:0:14350:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0d87594200/0xc6b31a1b598ead7b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b31a1b598ead74 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740516.093017:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0d87594200/0xc6b31a1b598ead7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b31a1b598ead74 expref: 16 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740516.093027:0:14350:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0d87594200/0xc6b31a1b598ead7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598ead74 expref: 16 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740516.093045:0:14350:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d87594200, rc 0) 00000100:00100000:2.0:1790740516.093084:0:14350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8742ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+16:15040:x1877727158299264:12345-0@lo:101:mount.lustre.0 Request processed in 117us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740516.093091:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790740516.093136:0:15040:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd7d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15040:1877727158299264:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790740516.093151:0:15040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.158@tcp lock: ffff8f0d87594000/0xc6b31a1b598ead74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598ead7b expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740516.093160:0:15040:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.158@tcp lock: ffff8f0d87594000/0xc6b31a1b598ead74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598ead7b expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790740516.093765:0:15040:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1790740516.094034:0:15040:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790740516.094276:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1790740516.094320:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1790740516.094352:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1790740516.094401:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1790740516.094439:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1790740516.094504:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1790740516.094538:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1790740516.094567:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1790740516.094639:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1790740516.094671:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1790740516.094700:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1790740516.094745:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1790740516.094780:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1790740516.094814:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1790740516.094863:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1790740516.094915:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1790740516.094969:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1790740516.095019:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1790740516.095056:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1790740516.095089:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1790740516.095134:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1790740516.095171:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1790740516.095207:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1790740516.095272:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1790740516.095315:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1790740516.095350:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1790740516.095400:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1790740516.095440:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1790740516.102749:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1790740516.102774:0:15040:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1790740516.102887:0:15040:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd7d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15040:1877727158299392:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790740516.103092:0:15040:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740516.103159:0:15040:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0dc102c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790740516.103183:0:14351:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158299392 00000100:00100000:2.0:1790740516.103191:0:14351:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158299392 00000100:00100000:2.0:1790740516.103236:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790740516.103245:0:14350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8742fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+16:15040:x1877727158299392:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790740516.103818:0:14350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8742fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+16:15040:x1877727158299392:12345-0@lo:501:mount.lustre.0 Request processed in 573us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740516.103827:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790740516.103941:0:15040:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd7d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15040:1877727158299392:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790740516.104065:0:15040:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd7d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15040:1877727158299520:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790740516.104105:0:15040:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740516.104202:0:15040:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0dc102c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790740516.104219:0:14351:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158299520 00000100:00100000:2.0:1790740516.104223:0:14351:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158299520 00000100:00100000:2.0:1790740516.104242:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790740516.104248:0:14351:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8742f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:752c79c8-24e4-410a-832f-aac51b94c085+16:15040:x1877727158299520:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790740516.104683:0:14351:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8742f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:752c79c8-24e4-410a-832f-aac51b94c085+16:15040:x1877727158299520:12345-0@lo:503:mount.lustre.0 Request processed in 433us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740516.104692:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790740516.104738:0:15040:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd7d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15040:1877727158299520:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790740516.106045:0:15040:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790740516.106121:0:15040:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd7d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15040:1877727158299648:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790740516.106186:0:15040:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740516.106237:0:15040:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d828a79c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790740516.109628:0:14351:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158299648 00000100:00100000:3.0:1790740516.109642:0:14351:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158299648 00000100:00100000:3.0:1790740516.109703:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790740516.109714:0:14350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8742e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+16:15040:x1877727158299648:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790740516.110013:0:14350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8742e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+16:15040:x1877727158299648:12345-0@lo:502:mount.lustre.0 Request processed in 300us (3825us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740516.110022:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790740516.112312:0:15040:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd7d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15040:1877727158299648:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790740516.112708:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1790740516.112784:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1790740516.112819:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1790740516.112862:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1790740516.112895:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1790740516.112938:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1790740516.112974:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1790740516.113006:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1790740516.113053:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1790740516.113085:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1790740516.113114:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1790740516.113156:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1790740516.113189:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1790740516.113219:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1790740516.113277:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1790740516.113313:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1790740516.113364:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1790740516.113414:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1790740516.113447:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1790740516.113495:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1790740516.113543:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1790740516.113599:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1790740516.113648:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1790740516.113705:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1790740516.113748:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1790740516.113793:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1790740516.113836:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1790740516.113868:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1790740516.113899:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1790740516.113945:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1790740516.113986:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1790740516.114021:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1790740516.114073:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1790740516.114122:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1790740516.114158:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1790740516.114206:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1790740516.114242:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1790740516.114276:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1790740516.114338:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1790740516.114378:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1790740516.114419:0:15040:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd7d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15040:1877727158299776:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790740516.114504:0:15040:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740516.114564:0:15040:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d828a79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790740516.116626:0:14349:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158299776 00000100:00100000:0.0:1790740516.116638:0:14349:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158299776 00000100:00100000:0.0:1790740516.116687:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790740516.116697:0:14349:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8742d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:752c79c8-24e4-410a-832f-aac51b94c085+16:15040:x1877727158299776:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790740516.116982:0:14349:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8742d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:752c79c8-24e4-410a-832f-aac51b94c085+16:15040:x1877727158299776:12345-0@lo:502:mount.lustre.0 Request processed in 286us (2478us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740516.116989:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790740516.117190:0:15040:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd7d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15040:1877727158299776:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790740516.117296:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1790740516.122026:0:15040:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1790740516.133005:0:15063:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1790740516.133037:0:15063:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8f0c84f1b380) 00000020:00000080:3.0:1790740516.133058:0:15063:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1790740516.133140:0:15063:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f0dbdaf3000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1790740516.133144:0:15063:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f0dbdaf3000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1790740516.133146:0:15063:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f0dbdaf3000 3 00010000:00080000:3.0:1790740516.133176:0:15063:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f0db76be800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.158@tcp at head 00010000:00010000:3.0:1790740516.137870:0:15063:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1790740516.139237:0:15063:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1790740516.139277:0:15063:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1790740516.139290:0:15063:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xc6b31a1b598ead89 00000100:00080000:3.0:1790740516.139300:0:15063:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790740516.139312:0:15063:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8f0db76be800 using connection 192.168.203.158@tcp/0@lo 00000100:00100000:3.0:1790740516.139356:0:15063:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f0db57ab480 x1877727158299904/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790740516.139400:0:15063:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1790740516.139431:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790740516.139436:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790740516.139438:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790740516.139441:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1790740516.140963:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db57ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1877727158299904:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790740516.141044:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740516.141129:0:14356:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158299904 00000100:00100000:1.0:1790740516.141136:0:14356:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158299904 00000100:00100000:1.0:1790740516.141166:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790740516.141173:0:14356:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1877727158299904:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1790740516.141198:0:14356:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 432 last 0 00000020:00000080:1.0:1790740516.141230:0:14356:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xc6b31a1b598ead90 00000004:00100000:1.0:1790740516.141251:0:14356:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1790740516.141285:0:14356:0:(import.c:65:import_set_state_nolock()) ffff8f0db9a61800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790740516.141996:0:14356:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877727158299904:12345-0@lo:38:llog_process_th.0 Request processed in 330us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740516.142007:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1790740516.142052:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8f0db57ab480 x1877727158299904/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790740526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740516.142063:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790740516.142070:0:3302:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1790740516.142077:0:3302:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1790740516.142081:0:3302:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1790740516.142084:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8f0db76be800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790740516.142090:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db57ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1877727158299904:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790740516.142691:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db57a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877727158300032:0@lo:400:kworker.0 00000100:00100000:1.0:1790740516.142738:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740516.142783:0:14357:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158300032 00000100:00100000:1.0:1790740516.142789:0:14357:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158300032 00000100:00100000:1.0:1790740516.142818:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790740516.142824:0:14357:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877727158300032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740516.143721:0:14357:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877727158300032:12345-0@lo:400:kworker.0 Request processed in 894us (979us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740516.143730:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1790740516.143769:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8f0db57a8700 x1877727158300032/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740516.143782:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db57a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877727158300032:0@lo:400:kworker.0 00010000:00010000:1.0:1790740516.146213:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790740516.147990:0:15063:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1790740516.148135:0:15040:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1790740516.148182:0:15040:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790740516.148206:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d87594000/0xc6b31a1b598ead74 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598ead7b expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740516.148217:0:15040:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.158@tcp lock: ffff8f0d87594000/0xc6b31a1b598ead74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598ead7b expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1790740516.148284:0:15040:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1790740516.148287:0:15040:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790740516.148288:0:15040:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790740516.148289:0:15040:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790740516.148291:0:15040:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790740516.148292:0:15040:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790740516.148294:0:15040:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790740516.148296:0:15040:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790740516.148297:0:15040:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790740516.148300:0:15040:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1790740516.148303:0:15040:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790740516.148304:0:15040:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790740516.148305:0:15040:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790740516.148306:0:15040:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790740516.148308:0:15040:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790740516.148309:0:15040:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790740516.148310:0:15040:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790740516.148311:0:15040:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790740516.148312:0:15040:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790740516.148399:0:15040:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1790740516.148419:0:15040:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1b40e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15040:1877727158300160:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1790740516.148495:0:15040:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740516.149295:0:15040:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0dc102c480 going to sleep for 11 seconds 00000100:00100000:3.0:1790740516.149424:0:14351:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158300160 00000100:00100000:3.0:1790740516.149432:0:14351:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158300160 00000100:00100000:3.0:1790740516.149482:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1790740516.149491:0:14351:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8742e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:752c79c8-24e4-410a-832f-aac51b94c085+16:15040:x1877727158300160:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1790740516.149669:0:14351:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1790740516.149682:0:14351:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1790740516.185174:0:14351:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1790740516.185285:0:14351:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1790740516.185385:0:14372:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1790740516.185390:0:14372:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1790740516.185413:0:14372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f0db6c0f800/0xc6b31a1b598ead97 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740516.185431:0:14372:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0d9f976e00/0xc6b31a1b598ead04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598eacfd expref: 16 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740516.185440:0:14372:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f0db6c0f800/0xc6b31a1b598ead97 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740516.187371:0:14372:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0d9f976e00/0xc6b31a1b598ead04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b31a1b598eacfd expref: 16 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740516.187389:0:14372:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f0d9f976e00/0xc6b31a1b598ead04 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b31a1b598eacfd expref: 16 pid: 14350 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740516.187403:0:14372:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd7d6300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14372:1877727158300288:0@lo:104: 00000100:00100000:2.0:1790740516.187473:0:14372:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740516.187537:0:14372:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d88340e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790740516.187607:0:14340:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158300288 00000100:00100000:3.0:1790740516.187617:0:14340:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158300288 00000100:00100000:3.0:1790740516.187657:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790740516.187666:0:14340:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd7d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:752c79c8-24e4-410a-832f-aac51b94c085+3:14372:x1877727158300288:12345-0@lo:104: 00010000:00010000:3.0:1790740516.187691:0:14340:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0f000/0xc6b31a1b598eacfd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598ead04 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740516.187750:0:14340:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790740516.187757:0:14340:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd7d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:752c79c8-24e4-410a-832f-aac51b94c085+3:14372:x1877727158300288:12345-0@lo:104: Request processed in 92us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740516.187764:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790740516.187896:0:14372:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd7d6300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14372:1877727158300288:0@lo:104: 00010000:00010000:2.0:1790740516.187917:0:14372:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f0db6c0f800/0xc6b31a1b598ead97 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740516.188169:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790740516.188177:0:14345:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0f000/0xc6b31a1b598eacfd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598ead04 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740516.188185:0:14345:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0f000 already unused, calling callback (ffffffffc1baec20) 10000000:00010000:1.0:1790740516.188189:0:14345:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0f000/0xc6b31a1b598eacfd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b31a1b598ead04 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740516.188197:0:14345:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0f000/0xc6b31a1b598eacfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b31a1b598ead04 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790740516.188274:0:14345:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0f000/0xc6b31a1b598eacfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b31a1b598ead04 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790740516.188280:0:14345:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1790740516.188353:0:14345:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0f000/0xc6b31a1b598eacfd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598ead04 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740516.188360:0:14345:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790740516.188388:0:14345:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0f000/0xc6b31a1b598eacfd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598ead04 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740516.188395:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0f000/0xc6b31a1b598eacfd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598ead04 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740516.188413:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740516.188415:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740516.188416:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740516.189614:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790740516.189635:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:752c79c8-24e4-410a-832f-aac51b94c085:3303:1877727158300416:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790740516.189686:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740516.189843:0:14343:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158300416 00000100:00100000:1.0:1790740516.189859:0:14343:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158300416 00010000:00010000:1.0:1790740516.189890:0:14343:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0d9f976e00/0xc6b31a1b598ead04 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598eacfd expref: 17 pid: 14350 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740516.189918:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790740516.189926:0:14343:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1b40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:752c79c8-24e4-410a-832f-aac51b94c085+17:3303:x1877727158300416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790740516.189939:0:14343:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740516.189945:0:14343:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0d9f976e00/0xc6b31a1b598ead04 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598eacfd expref: 17 pid: 14350 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740516.189956:0:14343:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0d9f976e00/0xc6b31a1b598ead04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b31a1b598eacfd expref: 17 pid: 14350 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740516.189971:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0d9f976e00/0xc6b31a1b598ead04 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b31a1b598eacfd expref: 17 pid: 14350 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740516.189999:0:14343:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f0db6c0f800/0xc6b31a1b598ead97 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740516.190007:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0db6c0f800/0xc6b31a1b598ead97 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790740516.190023:0:14343:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004632975s 00010000:00010000:1.0:1790740516.190028:0:14343:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f0db6c0f800/0xc6b31a1b598ead97 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740516.190034:0:14343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f0db6c0f800/0xc6b31a1b598ead97 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740516.190041:0:14343:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f0db6c0f800/0xc6b31a1b598ead97 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740516.190059:0:14343:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f0db6c0f800/0xc6b31a1b598ead97 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740516.190065:0:14343:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0f800 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:1.0:1790740516.190069:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f0db6c0f800/0xc6b31a1b598ead97 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740516.190078:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f0db6c0f800/0xc6b31a1b598ead97 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740516.190094:0:14343:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f0db6c0f800/0xc6b31a1b598ead97 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740516.190104:0:14343:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740516.190139:0:14343:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1b40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:752c79c8-24e4-410a-832f-aac51b94c085+16:3303:x1877727158300416:12345-0@lo:103:ldlm_bl.0 Request processed in 214us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740516.190146:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790740516.190185:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:752c79c8-24e4-410a-832f-aac51b94c085:3303:1877727158300416:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790740516.190388:0:14372:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f0db6c0f800/0xc6b31a1b598ead97 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740516.190397:0:14372:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f0db6c0f800/0xc6b31a1b598ead97 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740516.190403:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0db6c0f800/0xc6b31a1b598ead97 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740516.193670:0:14351:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8742e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:752c79c8-24e4-410a-832f-aac51b94c085+15:15040:x1877727158300160:12345-0@lo:253:mount.lustre.0 Request processed in 44172us (45167us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740516.193682:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790740516.193787:0:15040:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1b40e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15040:1877727158300160:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1790740516.193802:0:15040:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1790740516.193805:0:15040:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790740516.193807:0:15040:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790740516.193808:0:15040:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790740516.193809:0:15040:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790740516.193810:0:15040:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790740516.193812:0:15040:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790740516.193813:0:15040:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790740516.193814:0:15040:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790740516.193815:0:15040:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1790740516.193829:0:15040:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1790740516.199184:0:15040:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1790740516.199449:0:15040:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1790740516.199761:0:15040:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1790740516.199922:0:15040:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1790740516.200078:0:15040:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1790740516.200360:0:15040:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1790740516.201152:0:15040:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1790740516.246062:0:15040:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1790740516.246071:0:15040:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1790740516.246124:0:15040:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1790740516.246173:0:15040:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.158@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1790740516.246190:0:15040:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1790740516.246214:0:15040:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1790740517.169672:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790740517.361562:0:14353:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790740517.361569:0:14353:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f0c86750000 from 7 10000000:01000000:0.0:1790740517.361596:0:14353:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790740517.361640:0:14353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0dc132ec00/0xc6b31a1b598ead9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740517.361653:0:14353:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.158@tcp lock: ffff8f0dc132ec00/0xc6b31a1b598ead9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740517.361688:0:14353:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.158@tcp lock: ffff8f0dc132ec00/0xc6b31a1b598ead9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740517.361714:0:14353:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1b40e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:752c79c8-24e4-410a-832f-aac51b94c085:14353:1877727158300544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790740517.361790:0:14353:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740517.361852:0:14353:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d87573780 going to sleep for 11 seconds 00000100:00100000:3.0:1790740517.361871:0:14350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158300544 00000100:00100000:3.0:1790740517.361879:0:14350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158300544 00000100:00100000:3.0:1790740517.361930:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790740517.361940:0:14350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc132a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+15:14353:x1877727158300544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790740517.361954:0:14350:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740517.361969:0:14350:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0db6c0e800/0xc6b31a1b598eada5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b31a1b598ead9e expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740517.361994:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0db6c0e800/0xc6b31a1b598eada5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b31a1b598ead9e expref: 16 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740517.362005:0:14350:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0db6c0e800/0xc6b31a1b598eada5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598ead9e expref: 16 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740517.362014:0:14350:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0db6c0e800, rc 0) 00000100:00100000:3.0:1790740517.362062:0:14350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc132a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+16:14353:x1877727158300544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740517.362069:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790740517.362109:0:14353:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1b40e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:752c79c8-24e4-410a-832f-aac51b94c085:14353:1877727158300544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790740517.362124:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.158@tcp lock: ffff8f0dc132ec00/0xc6b31a1b598ead9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598eada5 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740517.362134:0:14353:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.158@tcp lock: ffff8f0dc132ec00/0xc6b31a1b598ead9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598eada5 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740517.362183:0:14353:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1b40e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:752c79c8-24e4-410a-832f-aac51b94c085:14353:1877727158300672:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1790740517.362212:0:14353:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740517.362233:0:14353:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d87573780 going to sleep for 11 seconds 00000100:00100000:3.0:1790740517.362275:0:14351:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158300672 00000100:00100000:3.0:1790740517.362280:0:14351:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158300672 00000100:00100000:3.0:1790740517.362308:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790740517.362314:0:14351:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1328050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:752c79c8-24e4-410a-832f-aac51b94c085+16:14353:x1877727158300672:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1790740517.362327:0:14351:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1790740517.362343:0:14351:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1790740517.362346:0:14351:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1790740517.362440:0:14351:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1328050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:752c79c8-24e4-410a-832f-aac51b94c085+16:14353:x1877727158300672:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 125us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740517.362457:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790740517.362485:0:14353:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1b40e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:752c79c8-24e4-410a-832f-aac51b94c085:14353:1877727158300672:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1790740517.363999:0:14353:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790740517.364008:0:14353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0dc132ec00/0xc6b31a1b598ead9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598eada5 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740517.364018:0:14353:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.158@tcp lock: ffff8f0dc132ec00/0xc6b31a1b598ead9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598eada5 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740518.192793:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740519.224844:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740520.240864:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790740521.268471:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790740521.268491:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790740521.268494:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790740521.268497:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1790740521.268539:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740521.268563:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1b40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:752c79c8-24e4-410a-832f-aac51b94c085:3305:1877727158300800:0@lo:400:kworker.0 00000100:00100000:0.0:1790740521.268651:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740521.268717:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790740521.268723:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1b43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877727158300928:0@lo:400:kworker.0 00000100:00100000:0.0:1790740521.268749:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740521.268782:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1b43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1877727158301056:0@lo:400:kworker.0 00000100:00100000:0.0:1790740521.268810:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740521.268845:0:14350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158300800 00000100:00100000:0.0:1790740521.268853:0:14350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158300800 00000100:00100000:0.0:1790740521.268895:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1790740521.268903:0:14350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1329c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+16:3305:x1877727158300800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740521.268952:0:14350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1329c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+16:3305:x1877727158300800:12345-0@lo:400:kworker.0 Request processed in 49us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740521.268958:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1790740521.268993:0:14358:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158300928 00000100:00100000:0.0:1790740521.268996:0:14358:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158300928 00000100:00100000:0.0:1790740521.269017:0:14358:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158301056 00000100:00100000:0.0:1790740521.269020:0:14358:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158301056 00000100:00100000:0.0:1790740521.269043:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790740521.269049:0:14358:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1b42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877727158300928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740521.269081:0:14358:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1b42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877727158300928:12345-0@lo:400:kworker.0 Request processed in 31us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740521.269094:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790740521.269107:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790740521.269112:0:14358:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1b41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1877727158301056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740521.269143:0:14358:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1b41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1877727158301056:12345-0@lo:400:kworker.0 Request processed in 31us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740521.269150:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1790740521.269207:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f0dc1b43b80 x1877727158301056/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740521.269220:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1b43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1877727158301056:0@lo:400:kworker.0 00010000:00080000:0.0:1790740521.269246:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f0dc1b43480 x1877727158300928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740521.269255:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1b43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877727158300928:0@lo:400:kworker.0 00000100:00100000:0.0:1790740521.269263:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1b40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:752c79c8-24e4-410a-832f-aac51b94c085:3305:1877727158300800:0@lo:400:kworker.0 00000100:00080000:3.0:1790740521.269949:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1790740522.243205:0:15409:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1790740522.291004:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740523.316350:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740524.349645:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790740524.722196:0:14391:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790740525.360687:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790740526.388728:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790740526.388735:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790740526.388738:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790740526.388741:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1790740526.388788:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1b40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:752c79c8-24e4-410a-832f-aac51b94c085:3304:1877727158301184:0@lo:400:kworker.0 00000100:00100000:0.0:1790740526.388858:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740526.388907:0:14351:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158301184 00000100:00100000:3.0:1790740526.388916:0:14351:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158301184 00000100:00100000:0.0:1790740526.388937:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1b43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877727158301312:0@lo:400:kworker.0 00000100:00100000:3.0:1790740526.388971:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790740526.388980:0:14351:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1329050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:752c79c8-24e4-410a-832f-aac51b94c085+16:3304:x1877727158301184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740526.389032:0:14351:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1329050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:752c79c8-24e4-410a-832f-aac51b94c085+16:3304:x1877727158301184:12345-0@lo:400:kworker.0 Request processed in 53us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740526.389039:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790740526.389091:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1b40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:752c79c8-24e4-410a-832f-aac51b94c085:3304:1877727158301184:0@lo:400:kworker.0 00000100:00100000:0.0:1790740526.389123:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740526.389204:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790740526.389211:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1b43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1877727158301440:0@lo:400:kworker.0 00000100:00100000:0.0:1790740526.389234:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790740526.389703:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740526.392283:0:14358:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158301312 00000100:00100000:3.0:1790740526.392297:0:14358:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158301312 00000100:00100000:0.0:1790740526.392322:0:14357:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158301440 00000100:00100000:0.0:1790740526.392326:0:14357:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158301440 00000100:00100000:0.0:1790740526.392393:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790740526.392403:0:14357:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1b41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877727158301440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740526.392469:0:14357:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1b41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877727158301440:12345-0@lo:400:kworker.0 Request processed in 68us (3232us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740526.392476:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1790740526.392495:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790740526.392515:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790740526.392523:0:14358:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1b43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877727158301312:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1790740526.392528:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f0dc1b43b80 x1877727158301440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740542 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790740526.392543:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1b43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1877727158301440:0@lo:400:kworker.0 00000100:00100000:3.0:1790740526.392566:0:14358:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1b43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877727158301312:12345-0@lo:400:kworker.0 Request processed in 45us (3443us total) trans 0 rc 0/0 00010000:00080000:0.0:1790740526.392566:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f0dc1b43480 x1877727158301312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740542 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740526.392591:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790740526.392722:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1b43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877727158301312:0@lo:400:kworker.0 00010000:00010000:2.0:1790740527.408756:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740527.408960:0:3302:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790740512/real 1790740512] req@ffff8f0dbda74a80 x1877727158297216/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790740527 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740527.408988:0:3302:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f0dbda74a80 x1877727158297216/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790740527 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740527.408999:0:3302:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790740512/real 1790740512] req@ffff8f0dbda77b80 x1877727158297344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790740527 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790740527.409011:0:3302:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f0dbda77b80 x1877727158297344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790740527 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1790740527.409029:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8f0d90bfa800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790740527.409051:0:3302:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1790740527.409056:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1877727158297216:0@lo:8:kworker.0 00000100:00080000:1.0:1790740527.409062:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8f0d83eed000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790740527.409067:0:3302:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1790740527.409069:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1877727158297344:0@lo:8:kworker.0 00000100:00080000:2.0:1790740527.409189:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790740527.409193:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1790740527.409197:0:8:0:(import.c:65:import_set_state_nolock()) ffff8f0d90bfa800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790740527.409201:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 428 00000100:00080000:2.0:1790740527.409206:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1790740527.409215:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8f0d90bfa800 using connection 192.168.203.158@tcp/0@lo 00000100:00100000:2.0:1790740527.409234:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f0dbd7d5880 x1877727158301696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790740527.409246:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790740527.409256:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1790740527.409259:0:8:0:(import.c:65:import_set_state_nolock()) ffff8f0d83eed000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790740527.409263:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 428 00000100:00080000:2.0:1790740527.409265:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1790740527.409269:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8f0d83eed000 using connection 192.168.203.158@tcp/0@lo 00000100:00100000:2.0:1790740527.409283:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f0dbd7d6680 x1877727158301824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790740527.409328:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd7d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1877727158302080:0@lo:400:kworker.0 00000100:00100000:2.0:1790740527.409402:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740527.409489:0:14356:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158302080 00000100:00100000:2.0:1790740527.409497:0:14356:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158302080 00000100:00100000:2.0:1790740527.409547:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790740527.409556:0:14356:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd7d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877727158302080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740527.409629:0:14356:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd7d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877727158302080:12345-0@lo:400:kworker.0 Request processed in 74us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740527.409637:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1790740527.409668:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f0dbd7d4700 x1877727158302080/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740527.409680:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd7d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1877727158302080:0@lo:400:kworker.0 00000100:00100000:1.0:1790740527.409887:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd7d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877727158301952:0@lo:400:kworker.0 00000100:00100000:1.0:1790740527.409918:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740527.409962:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790740527.409967:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd7d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:752c79c8-24e4-410a-832f-aac51b94c085:3304:1877727158301568:0@lo:400:kworker.0 00000100:00100000:1.0:1790740527.409991:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740527.410041:0:14349:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158301568 00000100:00100000:1.0:1790740527.410053:0:14349:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158301568 00000100:00100000:1.0:1790740527.410082:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1790740527.410088:0:14349:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc132b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:752c79c8-24e4-410a-832f-aac51b94c085+16:3304:x1877727158301568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740527.410125:0:14349:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc132b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:752c79c8-24e4-410a-832f-aac51b94c085+16:3304:x1877727158301568:12345-0@lo:400:kworker.0 Request processed in 37us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740527.410131:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1790740527.410159:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd7d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1877727158301696:0@lo:8:kworker.0 00000100:00100000:1.0:1790740527.410186:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740527.410202:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd7d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1877727158301824:0@lo:8:kworker.0 00000100:00100000:1.0:1790740527.410239:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740527.410272:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd7d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:752c79c8-24e4-410a-832f-aac51b94c085:3304:1877727158301568:0@lo:400:kworker.0 00000100:00100000:3.0:1790740527.412025:0:14358:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158301952 00000100:00100000:3.0:1790740527.412038:0:14358:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158301952 00000100:00100000:3.0:1790740527.412091:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790740527.412100:0:14358:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877727158301952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740527.412179:0:14358:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877727158301952:12345-0@lo:400:kworker.0 Request processed in 80us (2259us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740527.412184:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1790740527.412234:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f0dbd7d7800 x1877727158301952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740527.412248:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd7d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877727158301952:0@lo:400:kworker.0 00000100:00100000:2.0:1790740527.415190:0:15041:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158301696 00000100:00100000:2.0:1790740527.415204:0:15041:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158301696 00000100:00100000:2.0:1790740527.415232:0:15041:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158301824 00000100:00100000:2.0:1790740527.415235:0:15041:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158301824 00000100:00100000:2.0:1790740527.415249:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790740527.415259:0:15041:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3302:x1877727158301696:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1790740527.415289:0:15041:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 443 last 0 00000020:00000080:2.0:1790740527.415331:0:15041:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc6b31a1b598eadac 00002000:00100000:2.0:1790740527.415347:0:15041:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8f0dc136d800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b03 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1790740527.415351:0:15041:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1790740527.415354:0:15041:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1790740527.415732:0:15041:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1790740527.415756:0:15041:0:(import.c:65:import_set_state_nolock()) ffff8f0dc136d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790740527.415851:0:15041:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3302:x1877727158301696:12345-0@lo:8:kworker.0 Request processed in 593us (5662us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740527.415859:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790740527.415877:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790740527.415881:0:15041:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3302:x1877727158301824:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1790740527.415893:0:15041:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1790740527.415928:0:15041:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3302:x1877727158301824:12345-0@lo:8:kworker.0 Request processed in 45us (5688us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790740527.415934:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1790740527.416552:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f0dbd7d5880 x1877727158301696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790740547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740527.416565:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790740527.416595:0:3302:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1790740527.416603:0:3302:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1790740527.416608:0:3302:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1790740527.416611:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8f0d90bfa800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1790740527.416623:0:3302:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1790740527.416628:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd7d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1877727158301696:0@lo:8:kworker.0 00000100:00080000:3.0:1790740527.416642:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8f0d83eed000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790740527.416647:0:3302:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1790740527.416649:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd7d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1877727158301824:0@lo:8:kworker.0 00000004:00080000:1.0:1790740527.416882:0:14379:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:1.0:1790740527.416905:0:14379:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda76680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14379:1877727158302336:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1790740527.416946:0:14379:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740527.416966:0:14379:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0c865cd180 going to sleep for 11 seconds 00000004:00080000:1.0:1790740527.416982:0:14378:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1790740527.417219:0:14378:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 443367645122ns, next at 0ns, rc = 0 00000100:00100000:3.0:1790740527.417235:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158302208:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790740527.417285:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740527.417660:0:15044:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158302336 00000100:00100000:3.0:1790740527.417667:0:15044:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158302336 00000100:00100000:3.0:1790740527.417712:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790740527.417721:0:15044:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14379:x1877727158302336:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1790740527.417953:0:15045:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158302208 00000100:00100000:1.0:1790740527.417958:0:15045:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158302208 00000100:00100000:1.0:1790740527.417983:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790740527.417991:0:15045:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db57a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1877727158302208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790740527.418021:0:15045:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790740527.418068:0:15045:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db57a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1877727158302208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740527.418075:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1790740527.418907:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790740527.418977:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f0dbda76d80 x1877727158302208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740543 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740527.418998:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158302208:0@lo:13:osp-pre-0-0.0 00002000:00080000:3.0:1790740527.429117:0:15044:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1790740527.429129:0:15044:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1790740527.429135:0:15044:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:3.0:1790740527.439427:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790740527.439439:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba19b8fc/0xc6b31a1b598eadb3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.439455:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1790740527.439459:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790740527.439465:0:15044:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba19b8fc/0xc6b31a1b598eadb3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.441419:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba19b8fc/0xc6b31a1b598eadb3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.441439:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba19b8fc/0xc6b31a1b598eadb3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.441447:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba19b8fc/0xc6b31a1b598eadb3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.441482:0:15044:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790740527.441497:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740527.441503:0:14345:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba19b8fc/0xc6b31a1b598eadb3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.441511:0:14345:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0fc00 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:3.0:1790740527.441515:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba19b8fc/0xc6b31a1b598eadb3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.441524:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba19b8fc/0xc6b31a1b598eadb3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.441540:0:14345:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba19b8fc/0xc6b31a1b598eadb3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.441548:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba19b8fc/0xc6b31a1b598eadb3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.441567:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740527.441568:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740527.441596:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790740527.442518:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790740527.442526:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c497135/0xc6b31a1b598eadba lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.442539:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1790740527.442550:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790740527.442555:0:15044:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c497135/0xc6b31a1b598eadba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.442567:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c497135/0xc6b31a1b598eadba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.442602:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c497135/0xc6b31a1b598eadba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.442609:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c497135/0xc6b31a1b598eadba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.442628:0:15044:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790740527.442641:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740527.442646:0:14344:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c497135/0xc6b31a1b598eadba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.442654:0:14344:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0e000 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:3.0:1790740527.442658:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c497135/0xc6b31a1b598eadba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.442666:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c497135/0xc6b31a1b598eadba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.442678:0:14344:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c497135/0xc6b31a1b598eadba lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.442697:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c497135/0xc6b31a1b598eadba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.442711:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740527.442714:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740527.442715:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790740527.449641:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790740527.449654:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ec649b9/0xc6b31a1b598eadc1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.449671:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1790740527.449675:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790740527.449681:0:15044:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ec649b9/0xc6b31a1b598eadc1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.449693:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ec649b9/0xc6b31a1b598eadc1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.449704:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ec649b9/0xc6b31a1b598eadc1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.449713:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ec649b9/0xc6b31a1b598eadc1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.449737:0:15044:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790740527.449753:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740527.449768:0:14345:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ec649b9/0xc6b31a1b598eadc1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.449776:0:14345:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0f800 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:3.0:1790740527.449781:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ec649b9/0xc6b31a1b598eadc1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.449790:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ec649b9/0xc6b31a1b598eadc1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.449807:0:14345:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ec649b9/0xc6b31a1b598eadc1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.449815:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ec649b9/0xc6b31a1b598eadc1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.449833:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740527.449835:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740527.449837:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790740527.454050:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790740527.454063:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba19b8fc/0xc6b31a1b598eadc8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.454079:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1790740527.454083:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790740527.454090:0:15044:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba19b8fc/0xc6b31a1b598eadc8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.454116:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba19b8fc/0xc6b31a1b598eadc8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.454126:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba19b8fc/0xc6b31a1b598eadc8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.454134:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba19b8fc/0xc6b31a1b598eadc8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.454154:0:15044:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790740527.454168:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740527.454175:0:14344:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba19b8fc/0xc6b31a1b598eadc8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.454184:0:14344:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0fc00 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:3.0:1790740527.454189:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba19b8fc/0xc6b31a1b598eadc8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.454198:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba19b8fc/0xc6b31a1b598eadc8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.454215:0:14344:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba19b8fc/0xc6b31a1b598eadc8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.454223:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba19b8fc/0xc6b31a1b598eadc8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.454248:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740527.454250:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740527.454251:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790740527.459477:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790740527.459489:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf8135ce/0xc6b31a1b598eadcf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.459506:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1790740527.459511:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790740527.459517:0:15044:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf8135ce/0xc6b31a1b598eadcf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.459532:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf8135ce/0xc6b31a1b598eadcf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.459542:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf8135ce/0xc6b31a1b598eadcf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.459551:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf8135ce/0xc6b31a1b598eadcf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.459594:0:15044:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790740527.459823:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790740527.459832:0:14345:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf8135ce/0xc6b31a1b598eadcf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.459843:0:14345:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0f000 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:0.0:1790740527.459848:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf8135ce/0xc6b31a1b598eadcf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.459858:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf8135ce/0xc6b31a1b598eadcf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.459885:0:14345:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf8135ce/0xc6b31a1b598eadcf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.459892:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf8135ce/0xc6b31a1b598eadcf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.459916:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740527.459918:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740527.459920:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790740527.460030:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790740527.460036:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003779024a/0xc6b31a1b598eadd6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.460055:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1790740527.460058:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790740527.460062:0:15044:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003779024a/0xc6b31a1b598eadd6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.460071:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003779024a/0xc6b31a1b598eadd6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.460078:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003779024a/0xc6b31a1b598eadd6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.460085:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003779024a/0xc6b31a1b598eadd6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.460106:0:15044:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790740527.460384:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790740527.460390:0:14344:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003779024a/0xc6b31a1b598eadd6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.460399:0:14344:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0ee00 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:0.0:1790740527.460404:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003779024a/0xc6b31a1b598eadd6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.460412:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003779024a/0xc6b31a1b598eadd6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.460425:0:14344:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003779024a/0xc6b31a1b598eadd6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.460433:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003779024a/0xc6b31a1b598eadd6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.460466:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740527.460468:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740527.460471:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790740527.460508:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790740527.460514:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002de201c8/0xc6b31a1b598eaddd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.460522:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1790740527.460525:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790740527.460529:0:15044:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002de201c8/0xc6b31a1b598eaddd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.460537:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002de201c8/0xc6b31a1b598eaddd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.460556:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002de201c8/0xc6b31a1b598eaddd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.460563:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002de201c8/0xc6b31a1b598eaddd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.460592:0:15044:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790740527.460615:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790740527.460621:0:14345:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002de201c8/0xc6b31a1b598eaddd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.460629:0:14345:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0e400 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:0.0:1790740527.460633:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002de201c8/0xc6b31a1b598eaddd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.460641:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002de201c8/0xc6b31a1b598eaddd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.460653:0:14345:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002de201c8/0xc6b31a1b598eaddd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.460660:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002de201c8/0xc6b31a1b598eaddd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.460677:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740527.460680:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740527.460681:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790740527.460976:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790740527.460982:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088059c93/0xc6b31a1b598eade4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.460990:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1790740527.460993:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790740527.460997:0:15044:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088059c93/0xc6b31a1b598eade4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.461006:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088059c93/0xc6b31a1b598eade4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.461013:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088059c93/0xc6b31a1b598eade4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.461020:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088059c93/0xc6b31a1b598eade4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.461053:0:15044:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790740527.461456:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790740527.461462:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072210cc3/0xc6b31a1b598eadeb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.461470:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1790740527.461474:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790740527.461478:0:15044:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072210cc3/0xc6b31a1b598eadeb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.461486:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072210cc3/0xc6b31a1b598eadeb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.461494:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072210cc3/0xc6b31a1b598eadeb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.461501:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072210cc3/0xc6b31a1b598eadeb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.461520:0:15044:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1790740527.461530:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790740527.461534:0:14345:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088059c93/0xc6b31a1b598eade4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.461541:0:14345:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0f600 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:0.0:1790740527.461545:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740527.461554:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088059c93/0xc6b31a1b598eade4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.461563:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088059c93/0xc6b31a1b598eade4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.461598:0:14345:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088059c93/0xc6b31a1b598eade4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.461606:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088059c93/0xc6b31a1b598eade4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.461621:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740527.461622:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740527.461624:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740527.461897:0:15644:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740527.461904:0:14344:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072210cc3/0xc6b31a1b598eadeb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.461919:0:14344:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0ea00 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:0.0:1790740527.461923:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072210cc3/0xc6b31a1b598eadeb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.461932:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072210cc3/0xc6b31a1b598eadeb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.461943:0:14344:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072210cc3/0xc6b31a1b598eadeb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.461950:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072210cc3/0xc6b31a1b598eadeb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.461964:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740527.461966:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740527.461968:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740527.461972:0:15644:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740527.461973:0:15644:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790740527.462114:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790740527.462120:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092010423/0xc6b31a1b598eadf2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.462128:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1790740527.462131:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790740527.462135:0:15044:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092010423/0xc6b31a1b598eadf2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.462144:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092010423/0xc6b31a1b598eadf2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.462152:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092010423/0xc6b31a1b598eadf2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.462165:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092010423/0xc6b31a1b598eadf2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.462187:0:15044:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790740527.462355:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790740527.462361:0:14345:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092010423/0xc6b31a1b598eadf2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.462368:0:14345:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0ec00 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:0.0:1790740527.462372:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092010423/0xc6b31a1b598eadf2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.462402:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092010423/0xc6b31a1b598eadf2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.462413:0:14345:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092010423/0xc6b31a1b598eadf2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.462421:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092010423/0xc6b31a1b598eadf2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.462435:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740527.462437:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740527.462439:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790740527.474997:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790740527.475110:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008da15ad3/0xc6b31a1b598eadf9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.475130:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1790740527.475134:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790740527.475140:0:15044:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008da15ad3/0xc6b31a1b598eadf9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.475155:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008da15ad3/0xc6b31a1b598eadf9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.475166:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008da15ad3/0xc6b31a1b598eadf9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.475174:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008da15ad3/0xc6b31a1b598eadf9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.475194:0:15044:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790740527.475210:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740527.475216:0:14344:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008da15ad3/0xc6b31a1b598eadf9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.475231:0:14344:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0fa00 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:3.0:1790740527.475236:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008da15ad3/0xc6b31a1b598eadf9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.475245:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008da15ad3/0xc6b31a1b598eadf9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.475262:0:14344:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008da15ad3/0xc6b31a1b598eadf9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.475270:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008da15ad3/0xc6b31a1b598eadf9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.475289:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740527.475291:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740527.475293:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1790740527.479510:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:3.0:1790740527.488338:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790740527.488354:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ec649b9/0xc6b31a1b598eae00 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.488372:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1790740527.488390:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790740527.488396:0:15044:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ec649b9/0xc6b31a1b598eae00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.488425:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ec649b9/0xc6b31a1b598eae00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.488436:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ec649b9/0xc6b31a1b598eae00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.488444:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ec649b9/0xc6b31a1b598eae00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.488475:0:15044:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790740527.488615:0:15644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790740527.488628:0:15644:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ec649b9/0xc6b31a1b598eae00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740527.488639:0:15644:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0f800 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:1.0:1790740527.488644:0:15644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ec649b9/0xc6b31a1b598eae00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740527.488655:0:15644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ec649b9/0xc6b31a1b598eae00 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740527.488676:0:15644:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ec649b9/0xc6b31a1b598eae00 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740527.488685:0:15644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ec649b9/0xc6b31a1b598eae00 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740527.488708:0:15644:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740527.488711:0:15644:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740527.488714:0:15644:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790740527.489248:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790740527.489255:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c497135/0xc6b31a1b598eae07 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.489265:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1790740527.489268:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790740527.489273:0:15044:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c497135/0xc6b31a1b598eae07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.489283:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c497135/0xc6b31a1b598eae07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.489291:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c497135/0xc6b31a1b598eae07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.489311:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c497135/0xc6b31a1b598eae07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.489336:0:15044:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790740527.489382:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790740527.489388:0:14345:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c497135/0xc6b31a1b598eae07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740527.489396:0:14345:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0e000 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:1.0:1790740527.489401:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c497135/0xc6b31a1b598eae07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740527.489422:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c497135/0xc6b31a1b598eae07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740527.489436:0:14345:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c497135/0xc6b31a1b598eae07 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740527.489444:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c497135/0xc6b31a1b598eae07 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740527.489461:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740527.489463:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740527.489465:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790740527.490390:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790740527.490400:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed2fb401/0xc6b31a1b598eae0e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.490412:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1790740527.490416:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790740527.490421:0:15044:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed2fb401/0xc6b31a1b598eae0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.490431:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed2fb401/0xc6b31a1b598eae0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.490439:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed2fb401/0xc6b31a1b598eae0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.490446:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed2fb401/0xc6b31a1b598eae0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.490463:0:15044:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790740527.490475:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740527.490480:0:14344:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed2fb401/0xc6b31a1b598eae0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.490497:0:14344:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0fe00 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:3.0:1790740527.490501:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed2fb401/0xc6b31a1b598eae0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.490509:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed2fb401/0xc6b31a1b598eae0e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.490522:0:14344:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed2fb401/0xc6b31a1b598eae0e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.490529:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed2fb401/0xc6b31a1b598eae0e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.490547:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740527.490549:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740527.490551:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790740527.496949:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790740527.496965:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008da15ad3/0xc6b31a1b598eae15 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.496983:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1790740527.496988:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790740527.496994:0:15044:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008da15ad3/0xc6b31a1b598eae15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.497022:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008da15ad3/0xc6b31a1b598eae15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.497041:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008da15ad3/0xc6b31a1b598eae15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.497050:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008da15ad3/0xc6b31a1b598eae15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.497076:0:15044:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790740527.497211:0:15644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790740527.497220:0:15644:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008da15ad3/0xc6b31a1b598eae15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740527.497240:0:15644:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0fa00 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:1.0:1790740527.497246:0:15644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008da15ad3/0xc6b31a1b598eae15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740527.497258:0:15644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008da15ad3/0xc6b31a1b598eae15 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740527.497279:0:15644:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008da15ad3/0xc6b31a1b598eae15 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740527.497301:0:15644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008da15ad3/0xc6b31a1b598eae15 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740527.497323:0:15644:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740527.497325:0:15644:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740527.497328:0:15644:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790740527.500897:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790740527.500910:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088059c93/0xc6b31a1b598eae1c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.500927:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1790740527.500932:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790740527.500939:0:15044:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088059c93/0xc6b31a1b598eae1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.500954:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088059c93/0xc6b31a1b598eae1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.500963:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088059c93/0xc6b31a1b598eae1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.500971:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088059c93/0xc6b31a1b598eae1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.501054:0:15044:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790740527.501224:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790740527.501242:0:14345:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088059c93/0xc6b31a1b598eae1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740527.501254:0:14345:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0f600 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:1.0:1790740527.501260:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088059c93/0xc6b31a1b598eae1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740527.501272:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088059c93/0xc6b31a1b598eae1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740527.501293:0:14345:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088059c93/0xc6b31a1b598eae1c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740527.501302:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088059c93/0xc6b31a1b598eae1c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740527.501327:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740527.501330:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740527.501332:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790740527.505759:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790740527.505774:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000455a2745/0xc6b31a1b598eae23 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.505793:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=443s v=(0 0) 00010000:00010000:0.0:1790740527.505797:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740527.505803:0:15044:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000455a2745/0xc6b31a1b598eae23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.505817:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000455a2745/0xc6b31a1b598eae23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.505827:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000455a2745/0xc6b31a1b598eae23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.505842:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000455a2745/0xc6b31a1b598eae23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.505857:0:15044:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790740527.506339:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790740527.506346:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e17e00c7/0xc6b31a1b598eae2a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.506354:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=443s v=(0 0) 00010000:00010000:0.0:1790740527.506357:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740527.506361:0:15044:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e17e00c7/0xc6b31a1b598eae2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.506369:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e17e00c7/0xc6b31a1b598eae2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.506407:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e17e00c7/0xc6b31a1b598eae2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.506414:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e17e00c7/0xc6b31a1b598eae2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.506438:0:15044:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1790740527.506726:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790740527.506735:0:14344:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000455a2745/0xc6b31a1b598eae23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.506745:0:14344:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132e600 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:3.0:1790740527.506750:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000455a2745/0xc6b31a1b598eae23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.506761:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000455a2745/0xc6b31a1b598eae23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.506781:0:14344:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000455a2745/0xc6b31a1b598eae23 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.506790:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000455a2745/0xc6b31a1b598eae23 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.506825:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740527.506829:0:14344:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e17e00c7/0xc6b31a1b598eae2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.506837:0:14344:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132f600 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:3.0:1790740527.506841:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e17e00c7/0xc6b31a1b598eae2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.506865:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e17e00c7/0xc6b31a1b598eae2a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.506878:0:14344:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e17e00c7/0xc6b31a1b598eae2a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790740527.506880:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790740527.506891:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4bc8579/0xc6b31a1b598eae31 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.506893:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e17e00c7/0xc6b31a1b598eae2a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.506909:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740527.506909:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1790740527.506912:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740527.506915:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790740527.506916:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740527.506923:0:15044:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4bc8579/0xc6b31a1b598eae31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.506934:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4bc8579/0xc6b31a1b598eae31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.506942:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4bc8579/0xc6b31a1b598eae31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.506949:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4bc8579/0xc6b31a1b598eae31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.506969:0:15044:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790740527.507170:0:15644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790740527.507177:0:15644:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4bc8579/0xc6b31a1b598eae31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740527.507186:0:15644:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132ee00 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:2.0:1790740527.507190:0:15644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4bc8579/0xc6b31a1b598eae31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740527.507208:0:15644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4bc8579/0xc6b31a1b598eae31 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740527.507222:0:15644:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4bc8579/0xc6b31a1b598eae31 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740527.507229:0:15644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4bc8579/0xc6b31a1b598eae31 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740527.507245:0:15644:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740527.507247:0:15644:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740527.507249:0:15644:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790740527.507394:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790740527.507401:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008890b629/0xc6b31a1b598eae38 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.507409:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=443s v=(0 0) 00010000:00010000:0.0:1790740527.507412:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740527.507416:0:15044:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008890b629/0xc6b31a1b598eae38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.507426:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008890b629/0xc6b31a1b598eae38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.507445:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008890b629/0xc6b31a1b598eae38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.507451:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008890b629/0xc6b31a1b598eae38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.507474:0:15044:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790740527.507877:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790740527.507884:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085209935/0xc6b31a1b598eae3f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.507893:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=443s v=(0 0) 00010000:00010000:0.0:1790740527.507896:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740527.507900:0:15044:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085209935/0xc6b31a1b598eae3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.507910:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085209935/0xc6b31a1b598eae3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.507917:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085209935/0xc6b31a1b598eae3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.507925:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085209935/0xc6b31a1b598eae3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740527.507944:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790740527.507955:0:15044:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790740527.510245:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790740527.510261:0:14345:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085209935/0xc6b31a1b598eae3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740527.510276:0:14345:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132e000 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:1.0:1790740527.510281:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085209935/0xc6b31a1b598eae3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740527.510294:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085209935/0xc6b31a1b598eae3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740527.510318:0:14345:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085209935/0xc6b31a1b598eae3f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740527.510326:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085209935/0xc6b31a1b598eae3f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740527.510351:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740527.510354:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740527.510356:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740527.510444:0:14344:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008890b629/0xc6b31a1b598eae38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740527.510455:0:14344:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132e800 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:2.0:1790740527.510458:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008890b629/0xc6b31a1b598eae38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740527.510468:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008890b629/0xc6b31a1b598eae38 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740527.510480:0:14344:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008890b629/0xc6b31a1b598eae38 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740527.510503:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008890b629/0xc6b31a1b598eae38 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740527.510519:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740527.510521:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740527.510523:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740527.513135:0:15644:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790740527.514335:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790740527.514346:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b587cc4b/0xc6b31a1b598eae46 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.514364:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=443s v=(0 0) 00010000:00010000:0.0:1790740527.514368:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740527.514385:0:15044:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b587cc4b/0xc6b31a1b598eae46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.514400:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b587cc4b/0xc6b31a1b598eae46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.514411:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b587cc4b/0xc6b31a1b598eae46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.514419:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b587cc4b/0xc6b31a1b598eae46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.514444:0:15044:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790740527.515871:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790740527.515881:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2d86f09/0xc6b31a1b598eae4d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.515894:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=443s v=(0 0) 00010000:00010000:0.0:1790740527.515975:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740527.515981:0:15044:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2d86f09/0xc6b31a1b598eae4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.515993:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2d86f09/0xc6b31a1b598eae4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.516003:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2d86f09/0xc6b31a1b598eae4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.516011:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d2d86f09/0xc6b31a1b598eae4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.516091:0:15044:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1790740527.516691:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790740527.516698:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005859c61d/0xc6b31a1b598eae54 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.516707:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=443s v=(0 0) 00010000:00010000:0.0:1790740527.516710:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740527.516714:0:15044:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005859c61d/0xc6b31a1b598eae54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.516801:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005859c61d/0xc6b31a1b598eae54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.516809:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005859c61d/0xc6b31a1b598eae54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.516822:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005859c61d/0xc6b31a1b598eae54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.517050:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1790740527.517058:0:14344:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b587cc4b/0xc6b31a1b598eae46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.517067:0:14344:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132f400 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:3.0:1790740527.517072:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b587cc4b/0xc6b31a1b598eae46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.517081:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b587cc4b/0xc6b31a1b598eae46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.517098:0:14344:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b587cc4b/0xc6b31a1b598eae46 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.517118:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b587cc4b/0xc6b31a1b598eae46 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.517136:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790740527.517140:0:14344:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d2d86f09/0xc6b31a1b598eae4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.517146:0:14344:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132e400 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:3.0:1790740527.517149:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2d86f09/0xc6b31a1b598eae4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.517157:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2d86f09/0xc6b31a1b598eae4d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.517167:0:14344:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d2d86f09/0xc6b31a1b598eae4d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.517173:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2d86f09/0xc6b31a1b598eae4d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.517184:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740527.517186:0:14344:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005859c61d/0xc6b31a1b598eae54 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.517192:0:14344:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132e200 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:3.0:1790740527.517200:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005859c61d/0xc6b31a1b598eae54 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.517208:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005859c61d/0xc6b31a1b598eae54 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.517217:0:14344:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005859c61d/0xc6b31a1b598eae54 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.517224:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740527.517226:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740527.517228:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740527.517948:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740527.518025:0:15044:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1790740527.518032:0:15044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005859c61d/0xc6b31a1b598eae54 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790740527.518694:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790740527.518702:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cf7e740/0xc6b31a1b598eae5b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.518712:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=443s v=(0 0) 00010000:00010000:0.0:1790740527.518716:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740527.518844:0:15044:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004cf7e740/0xc6b31a1b598eae5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.518858:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004cf7e740/0xc6b31a1b598eae5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.518867:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cf7e740/0xc6b31a1b598eae5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.518874:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004cf7e740/0xc6b31a1b598eae5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.519056:0:15644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740527.519064:0:15644:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004cf7e740/0xc6b31a1b598eae5b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.519072:0:15644:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132f800 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:3.0:1790740527.519076:0:15644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004cf7e740/0xc6b31a1b598eae5b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.519085:0:15644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004cf7e740/0xc6b31a1b598eae5b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.519100:0:15644:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004cf7e740/0xc6b31a1b598eae5b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.519109:0:15644:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740527.519117:0:15644:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740527.519119:0:15644:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740527.519221:0:15044:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1790740527.519227:0:15044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004cf7e740/0xc6b31a1b598eae5b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790740527.519738:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790740527.519744:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e17e00c7/0xc6b31a1b598eae62 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.519754:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=443s v=(0 0) 00010000:00010000:0.0:1790740527.519757:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740527.519761:0:15044:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e17e00c7/0xc6b31a1b598eae62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.519770:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e17e00c7/0xc6b31a1b598eae62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.519777:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e17e00c7/0xc6b31a1b598eae62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.519784:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e17e00c7/0xc6b31a1b598eae62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.522888:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740527.522903:0:14344:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e17e00c7/0xc6b31a1b598eae62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.522917:0:14344:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132f600 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:3.0:1790740527.522923:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e17e00c7/0xc6b31a1b598eae62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.522934:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e17e00c7/0xc6b31a1b598eae62 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.522954:0:14344:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e17e00c7/0xc6b31a1b598eae62 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.522963:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740527.522965:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740527.522967:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740527.523038:0:15044:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1790740527.523047:0:15044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e17e00c7/0xc6b31a1b598eae62 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.523326:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790740527.525196:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790740527.525210:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000455a2745/0xc6b31a1b598eae69 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.525227:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=443s v=(0 0) 00010000:00010000:0.0:1790740527.525231:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740527.525305:0:15044:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000455a2745/0xc6b31a1b598eae69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.525322:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000455a2745/0xc6b31a1b598eae69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.525334:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000455a2745/0xc6b31a1b598eae69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.525341:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000455a2745/0xc6b31a1b598eae69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.525407:0:15044:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790740527.526141:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790740527.526149:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d61f48cd/0xc6b31a1b598eae70 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.526159:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=443s v=(0 0) 00010000:00010000:0.0:1790740527.526162:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790740527.526172:0:15044:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d61f48cd/0xc6b31a1b598eae70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.526182:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d61f48cd/0xc6b31a1b598eae70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.526189:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d61f48cd/0xc6b31a1b598eae70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.526196:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d61f48cd/0xc6b31a1b598eae70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.526435:0:15644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790740527.526537:0:15644:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000455a2745/0xc6b31a1b598eae69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.526547:0:15644:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132e600 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:3.0:1790740527.526553:0:15644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000455a2745/0xc6b31a1b598eae69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.526695:0:15644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000455a2745/0xc6b31a1b598eae69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.526714:0:15644:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000455a2745/0xc6b31a1b598eae69 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740527.527944:0:15044:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790740527.528125:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790740527.528134:0:14344:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d61f48cd/0xc6b31a1b598eae70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740527.528144:0:14344:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132ea00 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:2.0:1790740527.528150:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d61f48cd/0xc6b31a1b598eae70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740527.528159:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d61f48cd/0xc6b31a1b598eae70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740527.528174:0:14344:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d61f48cd/0xc6b31a1b598eae70 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740527.528182:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d61f48cd/0xc6b31a1b598eae70 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740527.528203:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740527.528205:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740527.528213:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1790740527.528271:0:15044:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:0.0:1790740527.528372:0:15044:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14379:x1877727158302336:12345-0@lo:5:osp-pre-0-0.0 Request processed in 110649us (111420us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740527.528399:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790740527.528417:0:14379:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda76680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14379:1877727158302336:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1790740527.528434:0:14379:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:2.0:1790740527.528493:0:14379:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd7d4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14379:1877727158302464:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1790740527.528531:0:14379:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740527.528627:0:14379:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d875496c0 going to sleep for 11 seconds 00010000:00010000:3.0:1790740527.528711:0:15644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000455a2745/0xc6b31a1b598eae69 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740527.528732:0:15644:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740527.528734:0:15644:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740527.528736:0:15644:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740527.528915:0:15043:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158302464 00000100:00100000:0.0:1790740527.528922:0:15043:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158302464 00000100:00100000:0.0:1790740527.528967:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790740527.528975:0:15043:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd7d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14379:x1877727158302464:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1790740527.529013:0:15043:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:0.0:1790740527.537890:0:15043:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd7d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14379:x1877727158302464:12345-0@lo:5:osp-pre-0-0.0 Request processed in 8907us (9350us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1790740527.537905:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790740527.537965:0:14379:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd7d4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14379:1877727158302464:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1790740527.537982:0:14379:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:3.0:1790740528.436937:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740529.456913:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1790740529.747230:0:15760:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1790740529.747234:0:15760:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1790740529.747348:0:15760:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8f0c84e4f800 00000020:01000004:0.0:1790740529.747373:0:15760:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1790740529.747386:0:15760:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1790740529.747400:0:15760:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8f0db6d78000) 00000020:00000080:0.0:1790740529.747415:0:15760:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1790740529.763919:0:15760:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1790740529.764184:0:15760:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1790740529.768919:0:15760:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1790740529.769172:0:15760:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1790740529.769438:0:15760:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1790740529.770143:0:15760:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 509: rc = 0 00100000:10000000:0.0:1790740529.770282:0:15760:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 509: rc = 0 00100000:10000000:0.0:1790740529.770637:0:15760:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 509: rc = 0 00100000:10000000:0.0:1790740529.771163:0:15760:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 278: rc = 0 00100000:10000000:0.0:1790740529.771423:0:15760:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 278: rc = 0 00100000:10000000:0.0:1790740529.773481:0:15760:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 278: rc = 0 00100000:10000000:2.0:1790740529.774099:0:15760:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 278: rc = 0 00100000:10000000:2.0:1790740529.774350:0:15760:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 278: rc = 0 00100000:10000000:2.0:1790740529.779998:0:15760:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 278: rc = 0 00000020:00000080:2.0:1790740529.780625:0:15760:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1790740529.780636:0:15760:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790740529.780646:0:15760:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc6b31a1b598eae7e 00000020:01000004:2.0:1790740529.780653:0:15760:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1790740529.780673:0:15760:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.158@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1790740529.780677:0:15760:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.158@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1790740529.780685:0:15760:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1790740529.780719:0:15760:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1790740529.780724:0:15760:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.158@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1790740529.808206:0:15760:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.158@tcp ctxt 0 is initialized 00000020:01000004:3.0:1790740529.808311:0:15760:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.158@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1790740529.808315:0:15760:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1790740529.808317:0:15760:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790740529.808319:0:15760:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790740529.808320:0:15760:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790740529.808321:0:15760:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790740529.808322:0:15760:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790740529.808324:0:15760:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790740529.808325:0:15760:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790740529.808327:0:15760:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790740529.808331:0:15760:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1790740529.808333:0:15760:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790740529.808335:0:15760:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790740529.808336:0:15760:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790740529.808338:0:15760:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790740529.808339:0:15760:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790740529.808346:0:15760:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790740529.808347:0:15760:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790740529.808347:0:15760:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790740529.808348:0:15760:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790740529.808384:0:15760:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1790740529.808403:0:15760:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db57a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15760:1877727158302592:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1790740529.808471:0:15760:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740529.811464:0:15760:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0dbda3d180 going to sleep for 11 seconds 00000100:00100000:0.0:1790740529.813937:0:14350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158302592 00000100:00100000:0.0:1790740529.813953:0:14350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158302592 00000100:00100000:1.0:1790740529.814114:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1790740529.814124:0:14350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1328450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+16:15760:x1877727158302592:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1790740529.814158:0:14350:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1790740529.814161:0:14350:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1790740529.814165:0:14350:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1790740529.847518:0:14350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1328450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+16:15760:x1877727158302592:12345-0@lo:253:mount.lustre.0 Request processed in 33388us (39039us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740529.847533:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790740529.849055:0:15760:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db57a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15760:1877727158302592:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1790740529.849070:0:15760:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1790740529.849073:0:15760:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790740529.849075:0:15760:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790740529.849077:0:15760:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790740529.849078:0:15760:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790740529.849079:0:15760:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790740529.849080:0:15760:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790740529.849082:0:15760:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790740529.849083:0:15760:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790740529.849084:0:15760:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1790740529.849104:0:15760:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8f0c84e4f800 from lustre-OST0001 10000000:01000000:3.0:1790740529.849127:0:15760:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1790740529.849130:0:15760:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1790740529.849136:0:15760:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8f0db5a719c0 local copy 00010000:00010000:3.0:1790740529.849146:0:15760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0f200/0xc6b31a1b598eac24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598eac2b expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740529.849375:0:15760:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db57a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15760:1877727158302720:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790740529.849422:0:15760:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740529.849470:0:15760:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0dbda3da80 going to sleep for 11 seconds 00000100:00100000:0.0:1790740529.849804:0:14351:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158302720 00000100:00100000:0.0:1790740529.849811:0:14351:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158302720 00000100:00100000:0.0:1790740529.849859:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1790740529.849868:0:14351:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc132b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:752c79c8-24e4-410a-832f-aac51b94c085+16:15760:x1877727158302720:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790740529.850146:0:14351:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc132b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:752c79c8-24e4-410a-832f-aac51b94c085+16:15760:x1877727158302720:12345-0@lo:501:mount.lustre.0 Request processed in 278us (722us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790740529.850154:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790740529.850244:0:15760:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db57a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15760:1877727158302720:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1790740529.850260:0:15760:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.158@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1790740529.850416:0:15760:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.158@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1790740529.850431:0:15760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0f200/0xc6b31a1b598eac24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598eac2b expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740529.850441:0:15760:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0f200/0xc6b31a1b598eac24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598eac2b expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740529.850466:0:15760:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f0c84e4f800 10000000:01000000:3.0:1790740529.850471:0:15760:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1790740529.850476:0:15760:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1790740529.850479:0:15760:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790740529.850483:0:15760:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1790740529.850486:0:15760:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1790740529.850511:0:15760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0fe00/0xc6b31a1b598eae85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740529.850520:0:15760:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0fe00/0xc6b31a1b598eae85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740529.850530:0:15760:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0fe00/0xc6b31a1b598eae85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740529.850545:0:15760:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db57a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15760:1877727158302848:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790740529.850691:0:15760:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740529.850770:0:15760:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0dbda3da80 going to sleep for 11 seconds 00000100:00100000:1.0:1790740529.854383:0:14350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158302848 00000100:00100000:1.0:1790740529.854398:0:14350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158302848 00000100:00100000:1.0:1790740529.854509:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790740529.854519:0:14350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc132ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+16:15760:x1877727158302848:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790740529.854536:0:14350:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740529.854554:0:14350:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0d9f976e00/0xc6b31a1b598eae8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b31a1b598eae85 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740529.854593:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0d9f976e00/0xc6b31a1b598eae8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b31a1b598eae85 expref: 17 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740529.854605:0:14350:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0d9f976e00/0xc6b31a1b598eae8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598eae85 expref: 17 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740529.854614:0:14350:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9f976e00, rc 0) 00000100:00100000:1.0:1790740529.854685:0:14350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc132ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+17:15760:x1877727158302848:12345-0@lo:101:mount.lustre.0 Request processed in 168us (3994us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740529.854692:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790740529.854776:0:15760:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db57a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15760:1877727158302848:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790740529.854792:0:15760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0fe00/0xc6b31a1b598eae85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598eae8c expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740529.854801:0:15760:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0fe00/0xc6b31a1b598eae85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598eae8c expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790740529.855447:0:15760:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1790740529.856116:0:15760:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790740529.856327:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1790740529.856378:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1790740529.856407:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1790740529.856444:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1790740529.856472:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1790740529.856497:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1790740529.856544:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1790740529.856550:0:15760:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1790740529.856660:0:15760:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db57a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15760:1877727158302976:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790740529.856716:0:15760:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740529.857636:0:15760:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0dbda3d240 going to sleep for 11 seconds 00000100:00100000:0.0:1790740529.857728:0:14351:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158302976 00000100:00100000:0.0:1790740529.857753:0:14351:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158302976 00000100:00100000:0.0:1790740529.857792:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1790740529.857800:0:14351:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc132a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:752c79c8-24e4-410a-832f-aac51b94c085+17:15760:x1877727158302976:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790740529.858295:0:14351:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc132a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:752c79c8-24e4-410a-832f-aac51b94c085+17:15760:x1877727158302976:12345-0@lo:501:mount.lustre.0 Request processed in 495us (1577us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740529.858303:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790740529.858454:0:15760:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db57a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15760:1877727158302976:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790740529.858496:0:15760:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db57a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15760:1877727158303104:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790740529.858543:0:15760:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740529.858682:0:15760:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0dbda3d240 going to sleep for 11 seconds 00000100:00100000:0.0:1790740529.858712:0:14351:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158303104 00000100:00100000:0.0:1790740529.858717:0:14351:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158303104 00000100:00100000:0.0:1790740529.858785:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790740529.858791:0:14351:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1329850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:752c79c8-24e4-410a-832f-aac51b94c085+17:15760:x1877727158303104:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790740529.859224:0:14351:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1329850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:752c79c8-24e4-410a-832f-aac51b94c085+17:15760:x1877727158303104:12345-0@lo:503:mount.lustre.0 Request processed in 433us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740529.859231:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1790740529.859292:0:15760:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db57a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15760:1877727158303104:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1790740529.859858:0:15760:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790740529.859926:0:15760:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db57a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15760:1877727158303232:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790740529.859969:0:15760:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740529.860146:0:15760:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0dbda3d240 going to sleep for 11 seconds 00000100:00100000:2.0:1790740529.860184:0:14349:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158303232 00000100:00100000:2.0:1790740529.860190:0:14349:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158303232 00000100:00100000:2.0:1790740529.860268:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790740529.860277:0:14349:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1328850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:752c79c8-24e4-410a-832f-aac51b94c085+17:15760:x1877727158303232:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790740529.860482:0:14349:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1328850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:752c79c8-24e4-410a-832f-aac51b94c085+17:15760:x1877727158303232:12345-0@lo:502:mount.lustre.0 Request processed in 207us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740529.860490:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1790740529.860562:0:15760:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db57a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15760:1877727158303232:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790740529.860806:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1790740529.860853:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1790740529.860902:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1790740529.860951:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1790740529.860987:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1790740529.861021:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1790740529.861087:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1790740529.861124:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1790740529.861166:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1790740529.861194:0:15760:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db57a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15760:1877727158303360:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790740529.861235:0:15760:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740529.861924:0:15760:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0dbda3d240 going to sleep for 11 seconds 00000100:00100000:1.0:1790740529.862036:0:14350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158303360 00000100:00100000:1.0:1790740529.862509:0:14350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158303360 00000100:00100000:1.0:1790740529.862682:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1790740529.862692:0:14350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc132a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+17:15760:x1877727158303360:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790740529.863191:0:14350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc132a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+17:15760:x1877727158303360:12345-0@lo:502:mount.lustre.0 Request processed in 500us (1954us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740529.863199:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790740529.865495:0:15760:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db57a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15760:1877727158303360:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790740529.866327:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1790740529.866344:0:15760:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1790740529.872431:0:15762:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790740529.872452:0:15762:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1790740529.872459:0:15762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740529.872462:0:15762:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1790740529.872493:0:15762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790740529.872510:0:15762:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8f0dbeb499c0) 00000020:00000080:1.0:1790740529.872569:0:15762:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1790740529.872612:0:15762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1790740529.872712:0:15762:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f0c84e4f800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1790740529.872721:0:15762:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1790740529.872755:0:15762:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc6b31a1b598eae9a 00010000:00010000:1.0:1790740529.889058:0:15762:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1790740529.889460:0:15762:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:2.0:1790740529.896873:0:15762:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1790740529.898368:0:15762:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1790740529.898380:0:15762:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790740529.898386:0:15762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790740529.898388:0:15762:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1790740529.898391:0:15762:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790740529.898395:0:15762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790740529.898397:0:15762:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790740529.898399:0:15762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790740529.898401:0:15762:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1790740529.898403:0:15762:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790740529.898405:0:15762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790740529.898406:0:15762:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:2.0:1790740529.898408:0:15762:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790740529.898411:0:15762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790740529.898412:0:15762:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1790740529.898415:0:15762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1790740529.898465:0:15762:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790740529.898468:0:15762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790740529.898469:0:15762:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1790740529.898472:0:15762:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1790740529.898663:0:15760:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1790740529.898686:0:15760:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.158@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1790740529.898701:0:15760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0fe00/0xc6b31a1b598eae85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598eae8c expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740529.898713:0:15760:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0fe00/0xc6b31a1b598eae85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598eae8c expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740529.898720:0:15760:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f0c84e4f800 from 1 10000000:01000000:3.0:1790740529.898723:0:15760:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790740529.898755:0:15760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0fc00/0xc6b31a1b598eaea1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740529.898763:0:15760:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0fc00/0xc6b31a1b598eaea1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740529.898774:0:15760:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0fc00/0xc6b31a1b598eaea1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740529.898802:0:15760:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db57a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15760:1877727158303488:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790740529.898860:0:15760:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740529.898915:0:15760:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0dbda3d240 going to sleep for 11 seconds 00000100:00100000:2.0:1790740529.899516:0:14350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158303488 00000100:00100000:2.0:1790740529.899526:0:14350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158303488 00000100:00100000:2.0:1790740529.899606:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1790740529.899616:0:14350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc132bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+17:15760:x1877727158303488:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790740529.899629:0:14350:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740529.899642:0:14350:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0d87595600/0xc6b31a1b598eaea8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b31a1b598eaea1 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740529.899666:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0d87595600/0xc6b31a1b598eaea8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b31a1b598eaea1 expref: 18 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740529.899676:0:14350:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0d87595600/0xc6b31a1b598eaea8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598eaea1 expref: 18 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740529.899696:0:14350:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d87595600, rc 0) 00000100:00100000:2.0:1790740529.899740:0:14350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc132bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+18:15760:x1877727158303488:12345-0@lo:101:mount.lustre.0 Request processed in 125us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740529.899746:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790740529.902302:0:15760:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db57a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15760:1877727158303488:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790740529.902330:0:15760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0fc00/0xc6b31a1b598eaea1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598eaea8 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740529.902342:0:15760:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0fc00/0xc6b31a1b598eaea1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598eaea8 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790740529.902879:0:15760:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1790740529.903243:0:15760:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790740529.903471:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1790740529.903522:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1790740529.903598:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1790740529.903606:0:15760:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1790740529.903664:0:15760:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db57a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15760:1877727158303616:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790740529.903718:0:15760:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740529.903770:0:15760:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0dbda3d240 going to sleep for 11 seconds 00000100:00100000:1.0:1790740529.904132:0:14351:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158303616 00000100:00100000:1.0:1790740529.904140:0:14351:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158303616 00000100:00100000:1.0:1790740529.904183:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1790740529.904192:0:14351:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1329450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:752c79c8-24e4-410a-832f-aac51b94c085+18:15760:x1877727158303616:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790740529.904404:0:14351:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1329450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:752c79c8-24e4-410a-832f-aac51b94c085+18:15760:x1877727158303616:12345-0@lo:501:mount.lustre.0 Request processed in 213us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740529.904412:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790740529.905241:0:15760:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db57a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15760:1877727158303616:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790740529.905285:0:15760:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db57a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15760:1877727158303744:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790740529.905333:0:15760:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740529.905422:0:15760:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0dbda3d240 going to sleep for 11 seconds 00000100:00100000:1.0:1790740529.915282:0:14349:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158303744 00000100:00100000:1.0:1790740529.915297:0:14349:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158303744 00000100:00100000:1.0:1790740529.915372:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1790740529.915382:0:14349:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1328c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:752c79c8-24e4-410a-832f-aac51b94c085+18:15760:x1877727158303744:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790740529.915643:0:14349:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1328c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:752c79c8-24e4-410a-832f-aac51b94c085+18:15760:x1877727158303744:12345-0@lo:503:mount.lustre.0 Request processed in 262us (10309us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740529.915651:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790740529.915781:0:15760:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db57a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15760:1877727158303744:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1790740529.916290:0:15760:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790740529.916447:0:15760:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db57a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15760:1877727158303872:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790740529.916498:0:15760:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740529.916558:0:15760:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0dbda3d240 going to sleep for 11 seconds 00000100:00100000:1.0:1790740529.918153:0:14350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158303872 00000100:00100000:1.0:1790740529.918165:0:14350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158303872 00000100:00100000:1.0:1790740529.918226:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790740529.918242:0:14350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d88286450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+18:15760:x1877727158303872:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790740529.918486:0:14350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d88286450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+18:15760:x1877727158303872:12345-0@lo:502:mount.lustre.0 Request processed in 252us (1988us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740529.918501:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1790740529.919165:0:15760:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db57a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15760:1877727158303872:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790740529.919448:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1790740529.919507:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1790740529.919557:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1790740529.919633:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1790740529.919668:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1790740529.919716:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1790740529.919752:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1790740529.919785:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1790740529.919821:0:15760:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db57a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15760:1877727158304000:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790740529.919878:0:15760:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740529.919925:0:15760:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0dbda3d240 going to sleep for 11 seconds 00000100:00100000:1.0:1790740529.920658:0:14350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158304000 00000100:00100000:1.0:1790740529.920666:0:14350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158304000 00000100:00100000:1.0:1790740529.920721:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790740529.920730:0:14350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8747dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+18:15760:x1877727158304000:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790740529.920933:0:14350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8747dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+18:15760:x1877727158304000:12345-0@lo:502:mount.lustre.0 Request processed in 203us (1054us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740529.920941:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790740529.921183:0:15760:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db57a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15760:1877727158304000:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790740529.921301:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1790740529.921315:0:15760:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1790740529.931617:0:15766:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790740529.931630:0:15766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740529.931633:0:15766:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1790740529.931641:0:15766:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f0c84e4f800 00000020:00000080:1.0:1790740529.931644:0:15766:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790740529.931651:0:15766:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790740529.931653:0:15766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740529.931655:0:15766:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1790740529.931658:0:15766:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790740529.931660:0:15766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740529.931661:0:15766:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1790740529.931664:0:15766:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f0c84e4f800 00000020:00000080:1.0:1790740529.931666:0:15766:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790740529.931721:0:15766:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790740529.931724:0:15766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740529.931725:0:15766:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1790740529.931728:0:15766:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790740529.931730:0:15766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740529.931731:0:15766:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790740529.931734:0:15766:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f0c84e4f800 00000020:00000080:1.0:1790740529.931736:0:15766:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790740529.931769:0:15766:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790740529.931789:0:15766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790740529.931790:0:15766:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1790740529.931794:0:15766:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1790740529.935051:0:15760:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1790740529.935088:0:15760:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790740529.935107:0:15760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0fc00/0xc6b31a1b598eaea1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598eaea8 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740529.935119:0:15760:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0fc00/0xc6b31a1b598eaea1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598eaea8 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740529.935163:0:15760:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1790740529.935166:0:15760:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f0c84e4f800 10000000:01000000:3.0:1790740529.935169:0:15760:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f0c84e4f800 10000000:01000000:3.0:1790740529.935178:0:15760:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790740529.935184:0:15760:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f0c84e4f800 from 1 10000000:01000000:3.0:1790740529.935187:0:15760:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790740529.935223:0:15760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0f600/0xc6b31a1b598eaeaf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740529.935231:0:15760:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0f600/0xc6b31a1b598eaeaf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740529.935243:0:15760:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0f600/0xc6b31a1b598eaeaf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740529.935268:0:15760:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db57a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15760:1877727158304128:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790740529.935334:0:15760:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740529.951004:0:14349:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158304128 00000100:00100000:1.0:1790740529.951023:0:14349:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158304128 00000100:00100000:1.0:1790740529.951090:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790740529.951099:0:14349:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8747e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:752c79c8-24e4-410a-832f-aac51b94c085+18:15760:x1877727158304128:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790740529.951116:0:14349:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740529.951135:0:14349:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0d9f977200/0xc6b31a1b598eaeb6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b31a1b598eaeaf expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740529.951162:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0d9f977200/0xc6b31a1b598eaeb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b31a1b598eaeaf expref: 19 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740529.951173:0:14349:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0d9f977200/0xc6b31a1b598eaeb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598eaeaf expref: 19 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740529.951187:0:14349:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9f977200, rc 0) 00000100:00100000:3.0:1790740529.952449:0:15760:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d81370300 going to sleep for 11 seconds 00000100:00100000:1.0:1790740529.956522:0:14349:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8747e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:752c79c8-24e4-410a-832f-aac51b94c085+19:15760:x1877727158304128:12345-0@lo:101:mount.lustre.0 Request processed in 5410us (21174us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740529.956535:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1790740529.956695:0:15760:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db57a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15760:1877727158304128:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790740529.956719:0:15760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0f600/0xc6b31a1b598eaeaf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598eaeb6 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740529.956732:0:15760:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0f600/0xc6b31a1b598eaeaf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598eaeb6 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790740529.957327:0:15760:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1790740529.957658:0:15760:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790740529.957901:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1790740529.957945:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1790740529.957975:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1790740529.958022:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1790740529.958057:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1790740529.958097:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1790740529.958141:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1790740529.958173:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1790740529.958217:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1790740529.958252:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1790740529.958285:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1790740529.958347:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1790740529.958399:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1790740529.958428:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1790740529.958472:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1790740529.958527:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1790740529.958558:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1790740529.958625:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1790740529.958659:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1790740529.958691:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1790740529.958739:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1790740529.958774:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1790740529.958805:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1790740529.958848:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1790740529.958880:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1790740529.958908:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1790740529.958950:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1790740529.958986:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1790740529.959020:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1790740529.959068:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:3.0:1790740529.959102:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:3.0:1790740529.959147:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:3.0:1790740529.959176:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:3.0:1790740529.959221:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:3.0:1790740529.959255:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:3.0:1790740529.959301:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:3.0:1790740529.959336:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:3.0:1790740529.959429:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:3.0:1790740529.959437:0:15760:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1790740529.959535:0:15760:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db57a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15760:1877727158304256:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790740529.959613:0:15760:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740529.959671:0:15760:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d81370300 going to sleep for 11 seconds 00000100:00100000:1.0:1790740529.959926:0:14351:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158304256 00000100:00100000:1.0:1790740529.959934:0:14351:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158304256 00000100:00100000:1.0:1790740529.959983:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790740529.959992:0:14351:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8747c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:752c79c8-24e4-410a-832f-aac51b94c085+19:15760:x1877727158304256:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790740529.960208:0:14351:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8747c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:752c79c8-24e4-410a-832f-aac51b94c085+19:15760:x1877727158304256:12345-0@lo:501:mount.lustre.0 Request processed in 217us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740529.960216:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1790740529.963749:0:15760:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db57a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15760:1877727158304256:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790740529.963808:0:15760:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1b43480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15760:1877727158304384:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790740529.963875:0:15760:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740529.963927:0:15760:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0dc1e1fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1790740529.964317:0:14349:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158304384 00000100:00100000:1.0:1790740529.964330:0:14349:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158304384 00000100:00100000:1.0:1790740529.964386:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1790740529.964396:0:14349:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8747c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:752c79c8-24e4-410a-832f-aac51b94c085+19:15760:x1877727158304384:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790740529.964605:0:14349:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8747c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:752c79c8-24e4-410a-832f-aac51b94c085+19:15760:x1877727158304384:12345-0@lo:503:mount.lustre.0 Request processed in 210us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740529.964613:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1790740529.965546:0:15760:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1b43480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15760:1877727158304384:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1790740529.967689:0:15760:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790740529.967777:0:15760:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db57ab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15760:1877727158304512:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790740529.967848:0:15760:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740529.967886:0:14350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158304512 00000100:00100000:3.0:1790740529.967892:0:14350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158304512 00000100:00100000:3.0:1790740529.967928:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790740529.967935:0:14350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8747e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+19:15760:x1877727158304512:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790740529.968135:0:14350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8747e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+19:15760:x1877727158304512:12345-0@lo:502:mount.lustre.0 Request processed in 200us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740529.968142:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790740529.968206:0:15760:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d81370300 going to sleep for 11 seconds 00000100:00100000:3.0:1790740529.968226:0:15760:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db57ab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15760:1877727158304512:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790740529.968463:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1790740529.968510:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1790740529.968542:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1790740529.968604:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1790740529.968642:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1790740529.968692:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1790740529.968744:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1790740529.968776:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1790740529.968822:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1790740529.968855:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1790740529.968885:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1790740529.968922:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1790740529.968950:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1790740529.968988:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1790740529.969029:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1790740529.969058:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1790740529.969085:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1790740529.969123:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1790740529.969152:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1790740529.969181:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1790740529.969222:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1790740529.969252:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1790740529.969300:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1790740529.969349:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1790740529.969400:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1790740529.969432:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1790740529.969471:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1790740529.969501:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1790740529.969532:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1790740529.969592:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1790740529.969629:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1790740529.969662:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1790740529.969694:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1790740529.969755:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1790740529.969792:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1790740529.969836:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1790740529.969866:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1790740529.969892:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1790740529.969946:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1790740529.969977:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1790740529.970017:0:15760:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db57ab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15760:1877727158304640:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790740529.970075:0:15760:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740529.970108:0:14351:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158304640 00000100:00100000:0.0:1790740529.970114:0:14351:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158304640 00000100:00100000:3.0:1790740529.970126:0:15760:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0dbec32a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790740529.970153:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1790740529.970162:0:14351:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8747c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:752c79c8-24e4-410a-832f-aac51b94c085+19:15760:x1877727158304640:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790740529.970374:0:14351:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8747c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:752c79c8-24e4-410a-832f-aac51b94c085+19:15760:x1877727158304640:12345-0@lo:502:mount.lustre.0 Request processed in 213us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740529.970382:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1790740529.976139:0:15760:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db57ab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15760:1877727158304640:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790740529.976374:0:15760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1790740529.976389:0:15760:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1790740529.977379:0:15771:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1790740529.977394:0:15771:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8f0dbeb4cd40) 00000020:00000080:1.0:1790740529.977418:0:15771:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1790740529.977513:0:15771:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f0c84e4f800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1790740529.977517:0:15771:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f0c84e4f800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1790740529.977520:0:15771:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f0c84e4f800 3 00010000:00080000:1.0:1790740529.977552:0:15771:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f0c84c59000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.158@tcp at head 00010000:00010000:1.0:1790740529.980110:0:15771:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1790740529.980554:0:15771:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1790740529.980706:0:15771:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1790740529.980717:0:15771:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xc6b31a1b598eaec4 00000100:00080000:1.0:1790740529.980726:0:15771:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790740529.980736:0:15771:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8f0c84c59000 using connection 192.168.203.158@tcp/0@lo 00000100:00100000:1.0:1790740529.980770:0:15771:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f0dbda75f80 x1877727158304768/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790740529.980792:0:15771:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1790740529.980867:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1877727158304768:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790740529.980932:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790740529.981101:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790740529.981105:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1790740529.981108:0:8:0:(import.c:65:import_set_state_nolock()) ffff8f0d83eed000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790740529.981113:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 443 00000100:00080000:2.0:1790740529.981117:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1790740529.981121:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8f0d83eed000 using connection 192.168.203.158@tcp/0@lo 00000100:00100000:2.0:1790740529.981133:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f0dbd7d5c00 x1877727158305024/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790740529.981172:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd7d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877727158305152:0@lo:400:kworker.0 00000100:00100000:2.0:1790740529.981197:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740529.981215:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790740529.981220:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd7d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158304896:0@lo:400:kworker.0 00000100:00100000:2.0:1790740529.981251:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740529.981274:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd7d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1877727158305024:0@lo:8:kworker.0 00000100:00100000:2.0:1790740529.981297:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740529.981321:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd7d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1877727158305280:0@lo:400:kworker.0 00000100:00100000:2.0:1790740529.981340:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740529.981379:0:14357:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158304768 00000100:00100000:2.0:1790740529.981393:0:14357:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158304768 00000100:00100000:2.0:1790740529.981411:0:14357:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158305152 00000100:00100000:2.0:1790740529.981413:0:14357:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158305152 00000100:00100000:2.0:1790740529.981430:0:14357:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158305280 00000100:00100000:2.0:1790740529.981432:0:14357:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158305280 00000100:00100000:2.0:1790740529.981452:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790740529.981459:0:14357:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd7d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877727158305152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740529.981503:0:14357:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd7d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877727158305152:12345-0@lo:400:kworker.0 Request processed in 43us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740529.981510:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790740529.981523:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790740529.981529:0:14357:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd7d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877727158305280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740529.981556:0:14357:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd7d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877727158305280:12345-0@lo:400:kworker.0 Request processed in 28us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740529.981562:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790740529.981597:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790740529.981601:0:14357:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db57ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3302:x1877727158304768:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1790740529.981620:0:14357:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 445 last 0 00000020:00000080:2.0:1790740529.981645:0:14357:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xc6b31a1b598eaecb 00000004:00100000:2.0:1790740529.981658:0:14357:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1790740529.981682:0:14357:0:(import.c:65:import_set_state_nolock()) ffff8f0dc136c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790740529.981715:0:14357:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db57ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877727158304768:12345-0@lo:38:llog_process_th.0 Request processed in 113us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740529.981721:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790740529.981739:0:15041:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158304896 00000100:00100000:2.0:1790740529.981742:0:15041:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158304896 00000100:00100000:2.0:1790740529.981762:0:15041:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158305024 00000100:00100000:2.0:1790740529.981771:0:15041:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158305024 00000100:00100000:2.0:1790740529.981784:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790740529.981789:0:15041:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd7d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3304:x1877727158304896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740529.981815:0:15041:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd7d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3304:x1877727158304896:12345-0@lo:400:kworker.0 Request processed in 26us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740529.981820:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790740529.981830:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790740529.981833:0:15041:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd7d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3302:x1877727158305024:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1790740529.981857:0:15041:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd7d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3302:x1877727158305024:12345-0@lo:8:kworker.0 Request processed in 22us (559us total) trans 0 rc -11/-11 00000100:00100000:2.0:1790740529.981861:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1790740529.981876:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790740529.981879:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790740529.981900:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd7d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158304896:0@lo:400:kworker.0 00010000:00080000:2.0:1790740529.981911:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f0dbd7d6680 x1877727158305152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740545 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740529.981921:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd7d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877727158305152:0@lo:400:kworker.0 00010000:00080000:2.0:1790740529.981946:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f0dbd7d5880 x1877727158305280/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740545 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740529.981954:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd7d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1877727158305280:0@lo:400:kworker.0 00000100:00100000:2.0:1790740529.981970:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790740529.981975:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8f0d83eed000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790740529.981978:0:3302:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1790740529.981981:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd7d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1877727158305024:0@lo:8:kworker.0 00010000:00080000:2.0:1790740529.981993:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f0dbda75f80 x1877727158304768/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790740539 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740529.982007:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790740529.982012:0:3302:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1790740529.982018:0:3302:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1790740529.982022:0:3302:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1790740529.982024:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8f0c84c59000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790740529.982029:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1877727158304768:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1790740529.985338:0:15771:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1790740529.985464:0:15760:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1790740529.985490:0:15760:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790740529.985515:0:15760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0f600/0xc6b31a1b598eaeaf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598eaeb6 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740529.985527:0:15760:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0f600/0xc6b31a1b598eaeaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598eaeb6 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1790740529.985603:0:15760:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1790740529.985606:0:15760:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790740529.985607:0:15760:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790740529.985609:0:15760:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790740529.985610:0:15760:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790740529.985612:0:15760:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790740529.985614:0:15760:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790740529.985615:0:15760:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790740529.985616:0:15760:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790740529.985620:0:15760:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1790740529.985622:0:15760:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790740529.985623:0:15760:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790740529.985624:0:15760:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790740529.985625:0:15760:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790740529.985626:0:15760:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790740529.985627:0:15760:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790740529.985628:0:15760:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790740529.985630:0:15760:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790740529.985631:0:15760:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790740529.985656:0:15760:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1790740529.985675:0:15760:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db57abb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15760:1877727158305408:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1790740529.985753:0:15760:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740529.985811:0:15760:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0dbec320c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790740529.985914:0:14349:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158305408 00000100:00100000:0.0:1790740529.985927:0:14349:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158305408 00000100:00100000:0.0:1790740529.985971:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1790740529.985980:0:14349:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8747d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:752c79c8-24e4-410a-832f-aac51b94c085+19:15760:x1877727158305408:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790740529.986005:0:14349:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1790740529.986092:0:14349:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1790740530.014793:0:14349:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1790740530.014806:0:14349:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1790740530.014856:0:14372:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1790740530.014861:0:14372:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1790740530.014891:0:14372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f0db6c0fa00/0xc6b31a1b598eaed2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740530.014909:0:14372:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0db6c0e800/0xc6b31a1b598eada5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598ead9e expref: 19 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740530.014918:0:14372:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f0db6c0fa00/0xc6b31a1b598eaed2 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740530.014957:0:14372:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0db6c0e800/0xc6b31a1b598eada5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b31a1b598ead9e expref: 19 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740530.014970:0:14372:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f0db6c0e800/0xc6b31a1b598eada5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b31a1b598ead9e expref: 19 pid: 14350 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740530.014985:0:14372:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db57a8380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14372:1877727158305536:0@lo:104: 00000100:00100000:3.0:1790740530.015046:0:14372:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740530.015104:0:14372:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d863a1f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790740530.015397:0:14339:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158305536 00000100:00100000:0.0:1790740530.015407:0:14339:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158305536 00000100:00100000:0.0:1790740530.015452:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790740530.015460:0:14339:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db57a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:752c79c8-24e4-410a-832f-aac51b94c085+3:14372:x1877727158305536:12345-0@lo:104: 00010000:00010000:0.0:1790740530.015473:0:14339:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.158@tcp lock: ffff8f0dc132ec00/0xc6b31a1b598ead9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598eada5 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740530.015533:0:14339:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790740530.015538:0:14339:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db57a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:752c79c8-24e4-410a-832f-aac51b94c085+3:14372:x1877727158305536:12345-0@lo:104: Request processed in 80us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740530.015545:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790740530.015652:0:14372:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db57a8380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14372:1877727158305536:0@lo:104: 00010000:00010000:2.0:1790740530.015673:0:14372:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f0db6c0fa00/0xc6b31a1b598eaed2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740530.015854:0:15644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790740530.015861:0:15644:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.158@tcp lock: ffff8f0dc132ec00/0xc6b31a1b598ead9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598eada5 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740530.015867:0:15644:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132ec00 already unused, calling callback (ffffffffc1baec20) 10000000:00010000:3.0:1790740530.015871:0:15644:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.158@tcp lock: ffff8f0dc132ec00/0xc6b31a1b598ead9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b31a1b598eada5 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740530.015888:0:15644:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.158@tcp lock: ffff8f0dc132ec00/0xc6b31a1b598ead9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b31a1b598eada5 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790740530.015915:0:15644:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.158@tcp lock: ffff8f0dc132ec00/0xc6b31a1b598ead9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b31a1b598eada5 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790740530.015921:0:15644:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1790740530.015959:0:15644:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.158@tcp lock: ffff8f0dc132ec00/0xc6b31a1b598ead9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598eada5 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740530.015966:0:15644:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790740530.015986:0:15644:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.158@tcp lock: ffff8f0dc132ec00/0xc6b31a1b598ead9e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598eada5 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740530.015995:0:15644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.158@tcp lock: ffff8f0dc132ec00/0xc6b31a1b598ead9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598eada5 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740530.016012:0:15644:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740530.016013:0:15644:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740530.016015:0:15644:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740530.016027:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db57a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:752c79c8-24e4-410a-832f-aac51b94c085:3306:1877727158305664:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790740530.016059:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740530.016113:0:14343:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158305664 00000100:00100000:3.0:1790740530.016117:0:14343:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158305664 00010000:00010000:3.0:1790740530.016136:0:14343:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0db6c0e800/0xc6b31a1b598eada5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598ead9e expref: 20 pid: 14350 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740530.016157:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790740530.016163:0:14343:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db57aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:752c79c8-24e4-410a-832f-aac51b94c085+20:3306:x1877727158305664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790740530.016173:0:14343:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740530.016178:0:14343:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0db6c0e800/0xc6b31a1b598eada5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598ead9e expref: 20 pid: 14350 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740530.016195:0:14343:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0db6c0e800/0xc6b31a1b598eada5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b31a1b598ead9e expref: 20 pid: 14350 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740530.016208:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0db6c0e800/0xc6b31a1b598eada5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b31a1b598ead9e expref: 20 pid: 14350 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740530.016220:0:14343:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f0db6c0fa00/0xc6b31a1b598eaed2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740530.016227:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0db6c0fa00/0xc6b31a1b598eaed2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790740530.016240:0:14343:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004632975s 00010000:00010000:3.0:1790740530.016244:0:14343:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f0db6c0fa00/0xc6b31a1b598eaed2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740530.016250:0:14343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f0db6c0fa00/0xc6b31a1b598eaed2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740530.016257:0:14343:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f0db6c0fa00/0xc6b31a1b598eaed2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740530.016263:0:14343:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f0db6c0fa00/0xc6b31a1b598eaed2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740530.016268:0:14343:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0fa00 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:3.0:1790740530.016271:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f0db6c0fa00/0xc6b31a1b598eaed2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740530.016278:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f0db6c0fa00/0xc6b31a1b598eaed2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740530.016298:0:14343:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f0db6c0fa00/0xc6b31a1b598eaed2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740530.016307:0:14343:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790740530.016335:0:14343:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db57aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:752c79c8-24e4-410a-832f-aac51b94c085+19:3306:x1877727158305664:12345-0@lo:103:ldlm_bl.0 Request processed in 173us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740530.016342:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790740530.016384:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db57a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:752c79c8-24e4-410a-832f-aac51b94c085:3306:1877727158305664:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790740530.016400:0:14372:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f0db6c0fa00/0xc6b31a1b598eaed2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740530.016407:0:14372:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f0db6c0fa00/0xc6b31a1b598eaed2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740530.016413:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0db6c0fa00/0xc6b31a1b598eaed2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740530.022945:0:14349:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8747d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:752c79c8-24e4-410a-832f-aac51b94c085+18:15760:x1877727158305408:12345-0@lo:253:mount.lustre.0 Request processed in 36958us (37185us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740530.022960:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790740530.023082:0:15760:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db57abb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:752c79c8-24e4-410a-832f-aac51b94c085:15760:1877727158305408:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1790740530.023098:0:15760:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1790740530.023101:0:15760:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790740530.023103:0:15760:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790740530.023104:0:15760:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790740530.023105:0:15760:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790740530.023106:0:15760:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790740530.023107:0:15760:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790740530.023109:0:15760:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790740530.023111:0:15760:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790740530.023112:0:15760:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1790740530.023126:0:15760:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1790740530.027368:0:15760:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1790740530.027522:0:15760:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1790740530.030075:0:15760:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1790740530.030256:0:15760:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1790740530.030431:0:15760:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1790740530.030651:0:15760:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1790740530.031314:0:15760:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1790740530.091708:0:15760:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1790740530.091718:0:15760:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1790740530.091821:0:15760:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1790740530.091960:0:15760:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.158@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1790740530.091975:0:15760:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1790740530.092074:0:15760:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1790740530.483639:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790740531.056972:0:14353:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790740531.056980:0:14353:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f0c86750000 from 8 10000000:01000000:0.0:1790740531.056985:0:14353:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790740531.057029:0:14353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0dc132e400/0xc6b31a1b598eaed9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740531.057042:0:14353:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.158@tcp lock: ffff8f0dc132e400/0xc6b31a1b598eaed9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740531.057064:0:14353:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.158@tcp lock: ffff8f0dc132e400/0xc6b31a1b598eaed9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740531.057089:0:14353:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1b43b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:752c79c8-24e4-410a-832f-aac51b94c085:14353:1877727158305792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790740531.057151:0:14353:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740531.057223:0:14353:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0c865cd180 going to sleep for 11 seconds 00000100:00100000:1.0:1790740531.057368:0:14351:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158305792 00000100:00100000:1.0:1790740531.057376:0:14351:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158305792 00000100:00100000:1.0:1790740531.057432:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790740531.057441:0:14351:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8747d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:752c79c8-24e4-410a-832f-aac51b94c085+18:14353:x1877727158305792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790740531.057454:0:14351:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740531.057468:0:14351:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0d9f977800/0xc6b31a1b598eaee0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b31a1b598eaed9 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740531.057502:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0d9f977800/0xc6b31a1b598eaee0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b31a1b598eaed9 expref: 19 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740531.057514:0:14351:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0d9f977800/0xc6b31a1b598eaee0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598eaed9 expref: 19 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740531.057523:0:14351:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9f977800, rc 0) 00000100:00100000:1.0:1790740531.057594:0:14351:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8747d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:752c79c8-24e4-410a-832f-aac51b94c085+19:14353:x1877727158305792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740531.057601:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1790740531.057806:0:14353:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1b43b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:752c79c8-24e4-410a-832f-aac51b94c085:14353:1877727158305792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790740531.057822:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.158@tcp lock: ffff8f0dc132e400/0xc6b31a1b598eaed9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598eaee0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740531.057832:0:14353:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.158@tcp lock: ffff8f0dc132e400/0xc6b31a1b598eaed9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598eaee0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740531.057880:0:14353:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1b43b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:752c79c8-24e4-410a-832f-aac51b94c085:14353:1877727158305920:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1790740531.057987:0:14353:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740531.058165:0:14353:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0c865cd180 going to sleep for 11 seconds 00000100:00100000:3.0:1790740531.060408:0:14349:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158305920 00000100:00100000:3.0:1790740531.060429:0:14349:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158305920 00000100:00100000:3.0:1790740531.061764:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790740531.061776:0:14349:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8747f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:752c79c8-24e4-410a-832f-aac51b94c085+19:14353:x1877727158305920:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1790740531.061800:0:14349:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1790740531.061818:0:14349:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1790740531.061821:0:14349:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1790740531.062095:0:14349:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8747f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:752c79c8-24e4-410a-832f-aac51b94c085+19:14353:x1877727158305920:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 321us (4106us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740531.062104:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1790740531.062192:0:14353:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1b43b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:752c79c8-24e4-410a-832f-aac51b94c085:14353:1877727158305920:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1790740531.062257:0:14353:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790740531.062267:0:14353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0dc132e400/0xc6b31a1b598eaed9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598eaee0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740531.062279:0:14353:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.158@tcp lock: ffff8f0dc132e400/0xc6b31a1b598eaed9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598eaee0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740531.508414:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1790740531.648710:0:6725:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1790740531.648743:0:6725:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1790740532.528892:0:15644:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740532.529157:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790740532.529179:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1b42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158306048:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790740532.529245:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740532.529401:0:15045:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158306048 00000100:00100000:0.0:1790740532.529410:0:15045:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158306048 00000100:00100000:0.0:1790740532.529474:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790740532.529484:0:15045:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158306048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790740532.529529:0:15045:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790740532.529606:0:15045:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158306048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740532.529613:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1790740532.529728:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790740532.529772:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1790740532.529793:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1b42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158306048:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790740533.556599:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740534.584686:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790740534.963720:0:14391:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:1.0:1790740535.100717:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790740535.100724:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00100000:0.0:1790740535.100727:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158306304:0@lo:400:kworker.0 00000100:00080000:1.0:1790740535.100729:0:8:0:(import.c:65:import_set_state_nolock()) ffff8f0d83eed000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790740535.100746:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8f0d83eed000 using connection 192.168.203.158@tcp/0@lo 00000100:00100000:1.0:1790740535.100778:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f0dbda76680 x1877727158306432/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790740535.100799:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740535.101305:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:752c79c8-24e4-410a-832f-aac51b94c085:3304:1877727158306176:0@lo:400:kworker.0 00000100:00100000:1.0:1790740535.101352:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740535.101387:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1877727158306816:0@lo:400:kworker.0 00000100:00100000:1.0:1790740535.101416:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740535.101437:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790740535.101443:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1877727158306688:0@lo:400:kworker.0 00000100:00100000:1.0:1790740535.101463:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740535.101749:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877727158306560:0@lo:400:kworker.0 00000100:00100000:3.0:1790740535.101778:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740535.101824:0:14350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158306176 00000100:00100000:3.0:1790740535.101832:0:14350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158306176 00000100:00100000:3.0:1790740535.101883:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790740535.101891:0:14350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8747f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+19:3304:x1877727158306176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740535.101936:0:14350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8747f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+19:3304:x1877727158306176:12345-0@lo:400:kworker.0 Request processed in 46us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740535.102497:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790740535.102536:0:14358:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158306816 00000100:00100000:3.0:1790740535.102681:0:14358:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158306816 00000100:00100000:3.0:1790740535.102719:0:14358:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158306688 00000100:00100000:3.0:1790740535.102723:0:14358:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158306688 00000100:00100000:3.0:1790740535.102734:0:14358:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158306560 00000100:00100000:3.0:1790740535.102736:0:14358:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158306560 00000100:00100000:3.0:1790740535.102746:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790740535.102752:0:14358:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1877727158306816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740535.102790:0:14358:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1877727158306816:12345-0@lo:400:kworker.0 Request processed in 38us (1373us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740535.102806:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790740535.102818:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790740535.102823:0:14358:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877727158306688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740535.102861:0:14358:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877727158306688:12345-0@lo:400:kworker.0 Request processed in 38us (1396us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740535.102867:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790740535.102878:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790740535.102883:0:14358:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db57abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877727158306560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740535.102913:0:14358:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db57abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877727158306560:12345-0@lo:400:kworker.0 Request processed in 30us (1134us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740535.102918:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790740535.103316:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1877727158306432:0@lo:8:kworker.0 00000100:00100000:0.0:1790740535.103380:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1790740535.103512:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dbda76d80 x1877727158306560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740535.103526:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877727158306560:0@lo:400:kworker.0 00010000:00080000:3.0:1790740535.103650:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dbda75180 x1877727158306688/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740535.103660:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1877727158306688:0@lo:400:kworker.0 00000100:00100000:3.0:1790740535.103671:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:752c79c8-24e4-410a-832f-aac51b94c085:3304:1877727158306176:0@lo:400:kworker.0 00010000:00080000:3.0:1790740535.103682:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dbda75c00 x1877727158306816/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740535.103690:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1877727158306816:0@lo:400:kworker.0 00000100:00100000:0.0:1790740535.103818:0:15041:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158306304 00000100:00100000:0.0:1790740535.103823:0:15041:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158306304 00000100:00100000:0.0:1790740535.103858:0:15041:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158306432 00000100:00100000:0.0:1790740535.103861:0:15041:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158306432 00000100:00100000:0.0:1790740535.103875:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790740535.103883:0:15041:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1b43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158306304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740535.103919:0:15044:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1790740535.103929:0:15044:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1790740535.103950:0:15043:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1790740535.103960:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790740535.103965:0:15043:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1b40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3302:x1877727158306432:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1790740535.103991:0:15043:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 451 last 0 00000020:00000080:0.0:1790740535.104025:0:15043:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc6b31a1b598eaee7 00002000:00100000:0.0:1790740535.104039:0:15043:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8f0c84e48000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b03 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1790740535.104043:0:15043:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1790740535.104046:0:15043:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1790740535.104674:0:15043:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1790740535.104700:0:15043:0:(import.c:65:import_set_state_nolock()) ffff8f0c84e4b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790740535.104760:0:15043:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1b40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3302:x1877727158306432:12345-0@lo:8:kworker.0 Request processed in 793us (1379us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740535.104768:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790740535.104816:0:15041:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1b43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158306304:12345-0@lo:400:kworker.0 Request processed in 934us (4018us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740535.104823:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1790740535.104854:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dbda76680 x1877727158306432/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790740560 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790740535.104875:0:3302:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1790740535.104882:0:3302:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1790740535.104888:0:3302:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1790740535.104890:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8f0d83eed000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1790740535.104903:0:3302:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1790740535.104908:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1877727158306432:0@lo:8:kworker.0 00000100:00100000:0.0:1790740535.104939:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158306304:0@lo:400:kworker.0 00000004:00080000:0.0:1790740535.104986:0:14381:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:0.0:1790740535.105003:0:14381:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1b40000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14381:1877727158307072:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1790740535.105031:0:14381:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740535.105049:0:14381:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0db6f3b9c0 going to sleep for 11 seconds 00000004:00080000:0.0:1790740535.105062:0:14380:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1790740535.105227:0:15044:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158307072 00000100:00100000:2.0:1790740535.105234:0:15044:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158307072 00000100:00100000:2.0:1790740535.105269:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790740535.105284:0:15044:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1b42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14381:x1877727158307072:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:1.0:1790740535.106111:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790740535.106116:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790740535.106119:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790740535.106255:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790740535.106277:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1b41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158306944:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790740535.106330:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1790740535.107759:0:14380:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 451058184133ns, next at 0ns, rc = 0 00002000:00080000:2.0:1790740535.123461:0:15044:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1790740535.123475:0:15044:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1790740535.123481:0:15044:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00000100:00100000:1.0:1790740535.128525:0:15045:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158306944 00000100:00100000:1.0:1790740535.128547:0:15045:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158306944 00000100:00100000:1.0:1790740535.128632:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790740535.128645:0:15045:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db57a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1877727158306944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790740535.128685:0:15045:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790740535.128777:0:15045:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db57a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1877727158306944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 135us (22457us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740535.128797:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1790740535.132160:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0dc1b41180 x1877727158306944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790740551 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740535.132186:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1b41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158306944:0@lo:13:osp-pre-1-0.0 00002000:00010000:2.0:1790740535.165251:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790740535.165980:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f01ebd8/0xc6b31a1b598eaeee lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.166161:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=451s v=(0 0) 00010000:00010000:2.0:1790740535.166166:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790740535.166172:0:15044:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f01ebd8/0xc6b31a1b598eaeee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.166192:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f01ebd8/0xc6b31a1b598eaeee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.166202:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f01ebd8/0xc6b31a1b598eaeee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.166210:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f01ebd8/0xc6b31a1b598eaeee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.166237:0:15044:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790740535.167279:0:15644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790740535.167288:0:15644:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f01ebd8/0xc6b31a1b598eaeee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.167298:0:15644:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87595e00 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:1.0:1790740535.167303:0:15644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f01ebd8/0xc6b31a1b598eaeee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.167313:0:15644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f01ebd8/0xc6b31a1b598eaeee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.167345:0:15644:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f01ebd8/0xc6b31a1b598eaeee lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.167352:0:15644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f01ebd8/0xc6b31a1b598eaeee lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.167379:0:15644:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740535.167381:0:15644:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740535.167383:0:15644:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790740535.169718:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790740535.169730:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f901496/0xc6b31a1b598eaef5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.169758:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=451s v=(0 0) 00010000:00010000:2.0:1790740535.169762:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790740535.169767:0:15044:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f901496/0xc6b31a1b598eaef5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.172166:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f901496/0xc6b31a1b598eaef5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.172188:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f901496/0xc6b31a1b598eaef5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.172198:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f901496/0xc6b31a1b598eaef5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.172224:0:15044:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790740535.172264:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790740535.172274:0:14345:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f901496/0xc6b31a1b598eaef5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740535.172283:0:14345:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87595400 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:0.0:1790740535.172288:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f901496/0xc6b31a1b598eaef5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740535.172298:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f901496/0xc6b31a1b598eaef5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740535.172332:0:14345:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f901496/0xc6b31a1b598eaef5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740535.172349:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f901496/0xc6b31a1b598eaef5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740535.172383:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740535.172386:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740535.172389:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790740535.172835:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790740535.172842:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099ee584f/0xc6b31a1b598eaefc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.172858:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=451s v=(0 0) 00010000:00010000:2.0:1790740535.172863:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790740535.172870:0:15044:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099ee584f/0xc6b31a1b598eaefc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.172882:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099ee584f/0xc6b31a1b598eaefc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.172901:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099ee584f/0xc6b31a1b598eaefc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.172909:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099ee584f/0xc6b31a1b598eaefc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.172924:0:15044:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790740535.173527:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790740535.173535:0:14344:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000099ee584f/0xc6b31a1b598eaefc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740535.173545:0:14344:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87594c00 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:0.0:1790740535.173549:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000099ee584f/0xc6b31a1b598eaefc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740535.173557:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000099ee584f/0xc6b31a1b598eaefc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740535.173584:0:14344:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000099ee584f/0xc6b31a1b598eaefc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740535.173593:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099ee584f/0xc6b31a1b598eaefc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740535.173611:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740535.173613:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740535.173615:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790740535.177263:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790740535.177278:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004ba155b/0xc6b31a1b598eaf03 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.177297:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=451s v=(0 0) 00010000:00010000:2.0:1790740535.177302:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790740535.177309:0:15044:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004ba155b/0xc6b31a1b598eaf03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.177334:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004ba155b/0xc6b31a1b598eaf03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.177345:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004ba155b/0xc6b31a1b598eaf03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.177354:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004ba155b/0xc6b31a1b598eaf03 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.177389:0:15044:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790740535.179621:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790740535.179633:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002060d9c8/0xc6b31a1b598eaf0a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.179650:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=451s v=(0 0) 00010000:00010000:2.0:1790740535.179655:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790740535.179660:0:15044:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002060d9c8/0xc6b31a1b598eaf0a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.179674:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002060d9c8/0xc6b31a1b598eaf0a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.179684:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002060d9c8/0xc6b31a1b598eaf0a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.179692:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002060d9c8/0xc6b31a1b598eaf0a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.179717:0:15044:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1790740535.179973:0:15644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790740535.179983:0:15644:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004ba155b/0xc6b31a1b598eaf03 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.180242:0:15644:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87594400 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:1.0:1790740535.180247:0:15644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004ba155b/0xc6b31a1b598eaf03 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.180267:0:15644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004ba155b/0xc6b31a1b598eaf03 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.180285:0:15644:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004ba155b/0xc6b31a1b598eaf03 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.180293:0:15644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004ba155b/0xc6b31a1b598eaf03 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.180314:0:15644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790740535.180327:0:15644:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002060d9c8/0xc6b31a1b598eaf0a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.180335:0:15644:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87595c00 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:1.0:1790740535.180338:0:15644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002060d9c8/0xc6b31a1b598eaf0a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.180346:0:15644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002060d9c8/0xc6b31a1b598eaf0a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.180356:0:15644:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002060d9c8/0xc6b31a1b598eaf0a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.180363:0:15644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002060d9c8/0xc6b31a1b598eaf0a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.180392:0:15644:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740535.180395:0:15644:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740535.180398:0:15644:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790740535.180726:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790740535.180733:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8bd5c51/0xc6b31a1b598eaf11 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.180742:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=451s v=(0 0) 00010000:00010000:2.0:1790740535.180824:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790740535.180829:0:15044:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8bd5c51/0xc6b31a1b598eaf11 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.180840:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8bd5c51/0xc6b31a1b598eaf11 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.180849:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8bd5c51/0xc6b31a1b598eaf11 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.180905:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8bd5c51/0xc6b31a1b598eaf11 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.180932:0:15044:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790740535.180965:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790740535.180971:0:14344:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8bd5c51/0xc6b31a1b598eaf11 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.180979:0:14344:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87595000 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:1.0:1790740535.180983:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8bd5c51/0xc6b31a1b598eaf11 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.181135:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8bd5c51/0xc6b31a1b598eaf11 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.181149:0:14344:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8bd5c51/0xc6b31a1b598eaf11 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.181157:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8bd5c51/0xc6b31a1b598eaf11 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.181172:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740535.181174:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740535.181175:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740535.181458:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790740535.181727:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790740535.181734:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de6ef9e6/0xc6b31a1b598eaf18 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.181744:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=451s v=(0 0) 00010000:00010000:2.0:1790740535.181748:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790740535.181829:0:15044:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de6ef9e6/0xc6b31a1b598eaf18 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.181840:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de6ef9e6/0xc6b31a1b598eaf18 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.181849:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de6ef9e6/0xc6b31a1b598eaf18 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.181917:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de6ef9e6/0xc6b31a1b598eaf18 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.181937:0:15044:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790740535.181959:0:15644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790740535.181967:0:15644:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de6ef9e6/0xc6b31a1b598eaf18 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.182001:0:15644:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87594a00 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:1.0:1790740535.182007:0:15644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de6ef9e6/0xc6b31a1b598eaf18 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.182016:0:15644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de6ef9e6/0xc6b31a1b598eaf18 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.182031:0:15644:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de6ef9e6/0xc6b31a1b598eaf18 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.182039:0:15644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de6ef9e6/0xc6b31a1b598eaf18 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.182054:0:15644:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740535.182056:0:15644:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740535.182058:0:15644:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790740535.182842:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790740535.182850:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9c266c8/0xc6b31a1b598eaf1f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.182918:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=451s v=(0 0) 00010000:00010000:2.0:1790740535.182921:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790740535.182926:0:15044:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9c266c8/0xc6b31a1b598eaf1f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.182936:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9c266c8/0xc6b31a1b598eaf1f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.182944:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9c266c8/0xc6b31a1b598eaf1f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.182952:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9c266c8/0xc6b31a1b598eaf1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.182975:0:15044:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790740535.183219:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790740535.183228:0:14344:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9c266c8/0xc6b31a1b598eaf1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740535.183238:0:14344:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d87594e00 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:0.0:1790740535.183242:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9c266c8/0xc6b31a1b598eaf1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740535.183250:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9c266c8/0xc6b31a1b598eaf1f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740535.183265:0:14344:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9c266c8/0xc6b31a1b598eaf1f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740535.183273:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9c266c8/0xc6b31a1b598eaf1f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740535.183295:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740535.183298:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740535.183300:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790740535.184372:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790740535.184381:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025c9c9cd/0xc6b31a1b598eaf26 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.184402:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=451s v=(0 0) 00010000:00010000:2.0:1790740535.184406:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790740535.184411:0:15044:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025c9c9cd/0xc6b31a1b598eaf26 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.184423:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025c9c9cd/0xc6b31a1b598eaf26 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.184432:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025c9c9cd/0xc6b31a1b598eaf26 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.184440:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000025c9c9cd/0xc6b31a1b598eaf26 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.184471:0:15044:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790740535.184510:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790740535.184518:0:14345:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000025c9c9cd/0xc6b31a1b598eaf26 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740535.184527:0:14345:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9fea6200 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:0.0:1790740535.184532:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000025c9c9cd/0xc6b31a1b598eaf26 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740535.184553:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000025c9c9cd/0xc6b31a1b598eaf26 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740535.184568:0:14345:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000025c9c9cd/0xc6b31a1b598eaf26 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740535.184594:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025c9c9cd/0xc6b31a1b598eaf26 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740535.184613:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740535.184615:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740535.184617:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790740535.185431:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790740535.185439:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000870d6c11/0xc6b31a1b598eaf2d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.185449:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=451s v=(0 0) 00010000:00010000:2.0:1790740535.185453:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790740535.185457:0:15044:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000870d6c11/0xc6b31a1b598eaf2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.185468:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000870d6c11/0xc6b31a1b598eaf2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.185489:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000870d6c11/0xc6b31a1b598eaf2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.185599:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000870d6c11/0xc6b31a1b598eaf2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.185618:0:15044:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790740535.187471:0:15644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790740535.187484:0:15644:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000870d6c11/0xc6b31a1b598eaf2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740535.187498:0:15644:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9fea7a00 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:0.0:1790740535.187502:0:15644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000870d6c11/0xc6b31a1b598eaf2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740535.187514:0:15644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000870d6c11/0xc6b31a1b598eaf2d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740535.187534:0:15644:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000870d6c11/0xc6b31a1b598eaf2d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740535.187558:0:15644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000870d6c11/0xc6b31a1b598eaf2d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740535.187602:0:15644:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740535.187604:0:15644:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740535.187605:0:15644:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790740535.189955:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790740535.189970:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ee61f87/0xc6b31a1b598eaf34 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.189988:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=451s v=(0 0) 00010000:00010000:2.0:1790740535.189993:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790740535.189999:0:15044:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ee61f87/0xc6b31a1b598eaf34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.190014:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ee61f87/0xc6b31a1b598eaf34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.190024:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ee61f87/0xc6b31a1b598eaf34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.190032:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ee61f87/0xc6b31a1b598eaf34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.190136:0:15044:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790740535.190838:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790740535.190847:0:14344:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ee61f87/0xc6b31a1b598eaf34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740535.190859:0:14344:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9fea7e00 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:0.0:1790740535.190864:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ee61f87/0xc6b31a1b598eaf34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740535.190875:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ee61f87/0xc6b31a1b598eaf34 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740535.190892:0:14344:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ee61f87/0xc6b31a1b598eaf34 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740535.190899:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ee61f87/0xc6b31a1b598eaf34 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740535.190921:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740535.190922:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740535.190924:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790740535.191260:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790740535.191267:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b64abb41/0xc6b31a1b598eaf3b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.191278:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=451s v=(0 0) 00010000:00010000:2.0:1790740535.191365:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790740535.191371:0:15044:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b64abb41/0xc6b31a1b598eaf3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.191382:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b64abb41/0xc6b31a1b598eaf3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.191390:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b64abb41/0xc6b31a1b598eaf3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.191397:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b64abb41/0xc6b31a1b598eaf3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.191420:0:15044:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790740535.191428:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790740535.191435:0:14345:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b64abb41/0xc6b31a1b598eaf3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740535.191445:0:14345:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9fea6e00 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:0.0:1790740535.191449:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b64abb41/0xc6b31a1b598eaf3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740535.191458:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b64abb41/0xc6b31a1b598eaf3b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740535.191472:0:14345:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b64abb41/0xc6b31a1b598eaf3b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740535.191479:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b64abb41/0xc6b31a1b598eaf3b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740535.191497:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740535.191499:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790740535.191501:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790740535.192041:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790740535.193583:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004909efbc/0xc6b31a1b598eaf42 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.193607:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=451s v=(0 0) 00010000:00010000:2.0:1790740535.193620:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790740535.193627:0:15044:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004909efbc/0xc6b31a1b598eaf42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.193641:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004909efbc/0xc6b31a1b598eaf42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.193652:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004909efbc/0xc6b31a1b598eaf42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.193661:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004909efbc/0xc6b31a1b598eaf42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.193683:0:15044:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790740535.194225:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790740535.194232:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcb7184b/0xc6b31a1b598eaf49 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.194242:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=451s v=(0 0) 00010000:00010000:2.0:1790740535.194245:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790740535.194249:0:15044:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fcb7184b/0xc6b31a1b598eaf49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.194260:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fcb7184b/0xc6b31a1b598eaf49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.194269:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcb7184b/0xc6b31a1b598eaf49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.194284:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fcb7184b/0xc6b31a1b598eaf49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.194302:0:15044:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1790740535.195434:0:15644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790740535.195445:0:15644:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004909efbc/0xc6b31a1b598eaf42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.195456:0:15644:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9fea6400 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:1.0:1790740535.195461:0:15644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004909efbc/0xc6b31a1b598eaf42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.195472:0:15644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004909efbc/0xc6b31a1b598eaf42 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.195500:0:15644:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004909efbc/0xc6b31a1b598eaf42 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.195508:0:15644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004909efbc/0xc6b31a1b598eaf42 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.195530:0:15644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790740535.195534:0:15644:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fcb7184b/0xc6b31a1b598eaf49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.195541:0:15644:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9fea6000 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:1.0:1790740535.195544:0:15644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcb7184b/0xc6b31a1b598eaf49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.195551:0:15644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcb7184b/0xc6b31a1b598eaf49 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.195560:0:15644:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fcb7184b/0xc6b31a1b598eaf49 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.195567:0:15644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fcb7184b/0xc6b31a1b598eaf49 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.195594:0:15644:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740535.195596:0:15644:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740535.195603:0:15644:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790740535.197179:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790740535.197247:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008c5e972/0xc6b31a1b598eaf50 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.197264:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=451s v=(0 0) 00010000:00010000:2.0:1790740535.197269:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790740535.197275:0:15044:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008c5e972/0xc6b31a1b598eaf50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.197289:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008c5e972/0xc6b31a1b598eaf50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.197299:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008c5e972/0xc6b31a1b598eaf50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.197308:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000008c5e972/0xc6b31a1b598eaf50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.197339:0:15044:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790740535.198965:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790740535.198977:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d5d3d8a/0xc6b31a1b598eaf57 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.198999:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=451s v=(0 0) 00010000:00010000:2.0:1790740535.199003:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790740535.199144:0:15044:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d5d3d8a/0xc6b31a1b598eaf57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.199159:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d5d3d8a/0xc6b31a1b598eaf57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.199168:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d5d3d8a/0xc6b31a1b598eaf57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.199176:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d5d3d8a/0xc6b31a1b598eaf57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.199269:0:15044:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1790740535.199351:0:15644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790740535.199361:0:15644:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000008c5e972/0xc6b31a1b598eaf50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.199372:0:15644:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9fea7400 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:1.0:1790740535.199377:0:15644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000008c5e972/0xc6b31a1b598eaf50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.199388:0:15644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000008c5e972/0xc6b31a1b598eaf50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.199406:0:15644:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000008c5e972/0xc6b31a1b598eaf50 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.199414:0:15644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008c5e972/0xc6b31a1b598eaf50 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.199435:0:15644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790740535.199439:0:15644:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d5d3d8a/0xc6b31a1b598eaf57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.199446:0:15644:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9fea7800 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:1.0:1790740535.199450:0:15644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d5d3d8a/0xc6b31a1b598eaf57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.199459:0:15644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d5d3d8a/0xc6b31a1b598eaf57 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.199479:0:15644:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d5d3d8a/0xc6b31a1b598eaf57 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.199487:0:15644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d5d3d8a/0xc6b31a1b598eaf57 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.199499:0:15644:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740535.199501:0:15644:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740535.199503:0:15644:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790740535.200931:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790740535.200941:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf86489a/0xc6b31a1b598eaf5e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.200954:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=451s v=(0 0) 00010000:00010000:2.0:1790740535.200959:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790740535.200964:0:15044:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf86489a/0xc6b31a1b598eaf5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.200975:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf86489a/0xc6b31a1b598eaf5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.200996:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf86489a/0xc6b31a1b598eaf5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.201003:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf86489a/0xc6b31a1b598eaf5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.201082:0:15044:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790740535.201161:0:15644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790740535.201169:0:15644:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf86489a/0xc6b31a1b598eaf5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.201178:0:15644:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9fea7000 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:1.0:1790740535.201183:0:15644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf86489a/0xc6b31a1b598eaf5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.201192:0:15644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf86489a/0xc6b31a1b598eaf5e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.201205:0:15644:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf86489a/0xc6b31a1b598eaf5e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.201213:0:15644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf86489a/0xc6b31a1b598eaf5e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.201241:0:15644:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740535.201243:0:15644:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740535.201245:0:15644:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790740535.202292:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790740535.202300:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6f7ecd5/0xc6b31a1b598eaf65 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.202311:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=451s v=(0 0) 00010000:00010000:2.0:1790740535.202315:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790740535.202327:0:15044:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6f7ecd5/0xc6b31a1b598eaf65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.202339:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6f7ecd5/0xc6b31a1b598eaf65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.202348:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6f7ecd5/0xc6b31a1b598eaf65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.202355:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6f7ecd5/0xc6b31a1b598eaf65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.202455:0:15044:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790740535.203459:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790740535.203467:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc71bf3e/0xc6b31a1b598eaf6c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.203552:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=451s v=(0 0) 00010000:00010000:2.0:1790740535.203557:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790740535.203563:0:15044:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc71bf3e/0xc6b31a1b598eaf6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.203755:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc71bf3e/0xc6b31a1b598eaf6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.203765:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc71bf3e/0xc6b31a1b598eaf6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.203773:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc71bf3e/0xc6b31a1b598eaf6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.203793:0:15044:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1790740535.204362:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790740535.204367:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe03e57a/0xc6b31a1b598eaf73 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.204379:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=451s v=(0 0) 00010000:00010000:2.0:1790740535.204385:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790740535.204389:0:15044:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe03e57a/0xc6b31a1b598eaf73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.204395:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe03e57a/0xc6b31a1b598eaf73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.204401:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe03e57a/0xc6b31a1b598eaf73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.204405:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe03e57a/0xc6b31a1b598eaf73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.204410:0:15044:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1790740535.205127:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790740535.205133:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012af23e2/0xc6b31a1b598eaf7a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.205142:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=451s v=(0 0) 00010000:00010000:2.0:1790740535.205145:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790740535.205148:0:15044:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012af23e2/0xc6b31a1b598eaf7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.205157:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012af23e2/0xc6b31a1b598eaf7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.205163:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012af23e2/0xc6b31a1b598eaf7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.205177:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000012af23e2/0xc6b31a1b598eaf7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.205185:0:15044:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1790740535.206031:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790740535.206038:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034db2d06/0xc6b31a1b598eaf81 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.206048:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=451s v=(0 0) 00010000:00010000:2.0:1790740535.206051:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790740535.206055:0:15044:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034db2d06/0xc6b31a1b598eaf81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.206063:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034db2d06/0xc6b31a1b598eaf81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.206070:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034db2d06/0xc6b31a1b598eaf81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.206078:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000034db2d06/0xc6b31a1b598eaf81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.206085:0:15044:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1790740535.207109:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790740535.207117:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df33269c/0xc6b31a1b598eaf88 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.207134:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=451s v=(0 0) 00010000:00010000:2.0:1790740535.207137:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790740535.207142:0:15044:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df33269c/0xc6b31a1b598eaf88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.207151:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df33269c/0xc6b31a1b598eaf88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.207159:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df33269c/0xc6b31a1b598eaf88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.207166:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000df33269c/0xc6b31a1b598eaf88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.207176:0:15044:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:2.0:1790740535.208052:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790740535.208059:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000412c0831/0xc6b31a1b598eaf8f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.208069:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=451s v=(0 0) 00010000:00010000:2.0:1790740535.208072:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790740535.208076:0:15044:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000412c0831/0xc6b31a1b598eaf8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.208085:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000412c0831/0xc6b31a1b598eaf8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.208103:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000412c0831/0xc6b31a1b598eaf8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.208110:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000412c0831/0xc6b31a1b598eaf8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.208119:0:15044:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:2.0:1790740535.208985:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790740535.208993:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b77e283d/0xc6b31a1b598eaf96 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.209005:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=451s v=(0 0) 00010000:00010000:2.0:1790740535.209008:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790740535.209013:0:15044:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b77e283d/0xc6b31a1b598eaf96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.209023:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b77e283d/0xc6b31a1b598eaf96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.209031:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b77e283d/0xc6b31a1b598eaf96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.209039:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b77e283d/0xc6b31a1b598eaf96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.209059:0:15044:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00010000:00010000:1.0:1790740535.209523:0:15644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:1.0:1790740535.209533:0:15644:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e6f7ecd5/0xc6b31a1b598eaf65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.209544:0:15644:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9fea7200 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:1.0:1790740535.209550:0:15644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6f7ecd5/0xc6b31a1b598eaf65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.209561:0:15644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6f7ecd5/0xc6b31a1b598eaf65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.209595:0:15644:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e6f7ecd5/0xc6b31a1b598eaf65 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.209603:0:15644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6f7ecd5/0xc6b31a1b598eaf65 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.209624:0:15644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1790740535.209628:0:15644:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc71bf3e/0xc6b31a1b598eaf6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.209635:0:15644:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9fea7600 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:1.0:1790740535.209645:0:15644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc71bf3e/0xc6b31a1b598eaf6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.209654:0:15644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc71bf3e/0xc6b31a1b598eaf6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.209665:0:15644:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc71bf3e/0xc6b31a1b598eaf6c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.209672:0:15644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc71bf3e/0xc6b31a1b598eaf6c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.209684:0:15644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1790740535.209688:0:15644:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe03e57a/0xc6b31a1b598eaf73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.209694:0:15644:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9fea6600 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:1.0:1790740535.209697:0:15644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe03e57a/0xc6b31a1b598eaf73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.209703:0:15644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe03e57a/0xc6b31a1b598eaf73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.209713:0:15644:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe03e57a/0xc6b31a1b598eaf73 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.209720:0:15644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe03e57a/0xc6b31a1b598eaf73 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.209740:0:15644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1790740535.209744:0:15644:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000012af23e2/0xc6b31a1b598eaf7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.209750:0:15644:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9fea7c00 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:1.0:1790740535.209753:0:15644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000012af23e2/0xc6b31a1b598eaf7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.209761:0:15644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000012af23e2/0xc6b31a1b598eaf7a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.209771:0:15644:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000012af23e2/0xc6b31a1b598eaf7a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.209778:0:15644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012af23e2/0xc6b31a1b598eaf7a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.209803:0:15644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1790740535.209806:0:15644:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000034db2d06/0xc6b31a1b598eaf81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.209812:0:15644:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9fea6800 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:1.0:1790740535.209815:0:15644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000034db2d06/0xc6b31a1b598eaf81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.209834:0:15644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000034db2d06/0xc6b31a1b598eaf81 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.209851:0:15644:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000034db2d06/0xc6b31a1b598eaf81 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.209858:0:15644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034db2d06/0xc6b31a1b598eaf81 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.209872:0:15644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1790740535.209876:0:15644:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000df33269c/0xc6b31a1b598eaf88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.209882:0:15644:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9fea6a00 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:1.0:1790740535.209885:0:15644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000df33269c/0xc6b31a1b598eaf88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.209893:0:15644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000df33269c/0xc6b31a1b598eaf88 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.209894:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790740535.209903:0:14344:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000412c0831/0xc6b31a1b598eaf8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.209907:0:15644:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000df33269c/0xc6b31a1b598eaf88 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.209917:0:14344:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0c84d0c000 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:1.0:1790740535.209923:0:15644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df33269c/0xc6b31a1b598eaf88 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.209924:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000412c0831/0xc6b31a1b598eaf8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.209942:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000412c0831/0xc6b31a1b598eaf8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.209970:0:14344:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000412c0831/0xc6b31a1b598eaf8f lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.209974:0:15644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790740535.209980:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000412c0831/0xc6b31a1b598eaf8f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.209981:0:15644:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b77e283d/0xc6b31a1b598eaf96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.210002:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740535.210004:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740535.210006:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740535.210013:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790740535.210456:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790740535.210463:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020db1362/0xc6b31a1b598eaf9d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.210743:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=451s v=(0 0) 00010000:00010000:2.0:1790740535.210748:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790740535.210754:0:15044:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020db1362/0xc6b31a1b598eaf9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.210769:0:15644:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0c84d0c800 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:2.0:1790740535.210774:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000020db1362/0xc6b31a1b598eaf9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.211055:0:15644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b77e283d/0xc6b31a1b598eaf96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.211118:0:15644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b77e283d/0xc6b31a1b598eaf96 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.211131:0:15644:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b77e283d/0xc6b31a1b598eaf96 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.211148:0:15644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b77e283d/0xc6b31a1b598eaf96 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.211154:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020db1362/0xc6b31a1b598eaf9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.211164:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000020db1362/0xc6b31a1b598eaf9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740535.211173:0:15644:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740535.211177:0:15644:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740535.211179:0:15644:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740535.211978:0:15044:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790740535.212267:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790740535.212274:0:14344:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000020db1362/0xc6b31a1b598eaf9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.212284:0:14344:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0c84d0d400 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:2.0:1790740535.212288:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000020db1362/0xc6b31a1b598eaf9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.212296:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000020db1362/0xc6b31a1b598eaf9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.212333:0:14344:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000020db1362/0xc6b31a1b598eaf9d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.212341:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000020db1362/0xc6b31a1b598eaf9d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.212358:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740535.212361:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740535.212363:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790740535.213517:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790740535.213528:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dea99db5/0xc6b31a1b598eafa4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.213542:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=451s v=(0 0) 00010000:00010000:2.0:1790740535.213546:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790740535.213551:0:15044:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dea99db5/0xc6b31a1b598eafa4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.213562:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dea99db5/0xc6b31a1b598eafa4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.213609:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dea99db5/0xc6b31a1b598eafa4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.213616:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dea99db5/0xc6b31a1b598eafa4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.213643:0:15044:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790740535.213654:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790740535.213659:0:14345:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dea99db5/0xc6b31a1b598eafa4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.213665:0:14345:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0c84d0c600 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:2.0:1790740535.213669:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dea99db5/0xc6b31a1b598eafa4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.213677:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dea99db5/0xc6b31a1b598eafa4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.213689:0:14345:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dea99db5/0xc6b31a1b598eafa4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.213696:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dea99db5/0xc6b31a1b598eafa4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740535.213709:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740535.213711:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740535.213712:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1790740535.213942:0:15044:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:2.0:1790740535.214030:0:15044:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1b42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14381:x1877727158307072:12345-0@lo:5:osp-pre-1-0.0 Request processed in 108744us (108994us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740535.214039:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790740535.214100:0:14381:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1b40000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14381:1877727158307072:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1790740535.214115:0:14381:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:2.0:1790740535.214160:0:14381:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd7d5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14381:1877727158307200:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1790740535.214208:0:14381:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740535.214263:0:14381:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0c865cd840 going to sleep for 11 seconds 00000100:00100000:2.0:1790740535.214281:0:15043:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158307200 00000100:00100000:2.0:1790740535.214287:0:15043:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158307200 00000100:00100000:2.0:1790740535.214334:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790740535.214343:0:15043:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd7d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14381:x1877727158307200:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1790740535.214386:0:15043:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:2.0:1790740535.220804:0:15043:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd7d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14381:x1877727158307200:12345-0@lo:5:osp-pre-1-0.0 Request processed in 6455us (6588us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1790740535.220817:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790740535.220952:0:14381:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd7d5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14381:1877727158307200:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1790740535.220970:0:14381:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000004:00080000:3.0:1790740535.223308:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:3.0:1790740535.600735:0:15644:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740536.631894:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790740537.039301:0:16118:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg358-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1790740537.652988:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790740537.653016:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1b41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158307328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790740537.653088:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740537.653547:0:15045:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158307328 00000100:00100000:0.0:1790740537.653556:0:15045:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158307328 00000100:00100000:0.0:1790740537.653637:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790740537.653646:0:15045:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158307328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790740537.653679:0:15045:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790740537.653730:0:15045:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158307328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740537.653736:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1790740537.654069:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790740537.654131:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1b41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158307328:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790740537.655394:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740538.672693:0:15644:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740539.674639:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740539.674782:0:14349:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133146496 00000100:00100000:3.0:1790740539.674792:0:14349:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133146496 00000100:00100000:3.0:1790740539.674837:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 75 00000100:00100000:3.0:1790740539.674846:0:14349:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8747d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2368:x1877727133146496:12345-192.168.203.58@tcp:250:mount.lustre.0 00010000:00080000:3.0:1790740539.675055:0:14349:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 9dfd6896-73f9-47af-8d09-fc89b7bb7456@192.168.203.58@tcp t0 exp 0000000000000000 cur 455 last 0 00000020:00000080:3.0:1790740539.675083:0:14349:0:(genops.c:1384:class_connect()) connect: client 9dfd6896-73f9-47af-8d09-fc89b7bb7456, cookie 0xc6b31a1b598eafab 00000100:00080000:3.0:1790740539.675225:0:14349:0:(import.c:65:import_set_state_nolock()) ffff8f0db7a34800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790740539.675302:0:14349:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8747d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dfd6896-73f9-47af-8d09-fc89b7bb7456+5:2368:x1877727133146496:12345-192.168.203.58@tcp:250:mount.lustre.0 Request processed in 456us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740539.675310:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 75 00000100:00100000:2.0:1790740539.686234:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740539.686323:0:14351:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133146624 00000100:00100000:3.0:1790740539.686332:0:14351:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133146624 00000100:00100000:3.0:1790740539.686396:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 76 00000100:00100000:3.0:1790740539.686406:0:14351:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8747f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dfd6896-73f9-47af-8d09-fc89b7bb7456+5:13734:x1877727133146624:12345-192.168.203.58@tcp:101:mount.lustre.0 00010000:00010000:3.0:1790740539.686421:0:14351:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740539.686438:0:14351:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0db6c0e800/0xc6b31a1b598eafb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee7db expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740539.686481:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0db6c0e800/0xc6b31a1b598eafb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee7db expref: 6 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740539.686492:0:14351:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0db6c0e800/0xc6b31a1b598eafb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee7db expref: 6 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740539.686501:0:14351:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0db6c0e800, rc 0) 00000100:00100000:3.0:1790740539.686557:0:14351:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8747f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dfd6896-73f9-47af-8d09-fc89b7bb7456+6:13734:x1877727133146624:12345-192.168.203.58@tcp:101:mount.lustre.0 Request processed in 153us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740539.686564:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 76 00000100:00100000:2.0:1790740539.689788:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740539.696498:0:14350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133146752 00000100:00100000:0.0:1790740539.696514:0:14350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133146752 00000100:00100000:0.0:1790740539.696605:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 77 00000100:00100000:0.0:1790740539.696615:0:14350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbe60dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dfd6896-73f9-47af-8d09-fc89b7bb7456+6:13734:x1877727133146752:12345-192.168.203.58@tcp:501:mount.lustre.0 00000100:00100000:0.0:1790740539.697001:0:14350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbe60dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dfd6896-73f9-47af-8d09-fc89b7bb7456+6:13734:x1877727133146752:12345-192.168.203.58@tcp:501:mount.lustre.0 Request processed in 387us (7221us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790740539.697010:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 77 00010000:00010000:0.0:1790740539.697643:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740539.703671:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740539.703747:0:14349:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133146880 00000100:00100000:1.0:1790740539.703756:0:14349:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133146880 00000100:00100000:1.0:1790740539.703802:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 78 00000100:00100000:1.0:1790740539.703810:0:14349:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbe60d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dfd6896-73f9-47af-8d09-fc89b7bb7456+6:13734:x1877727133146880:12345-192.168.203.58@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790740539.703834:0:14349:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740539.703850:0:14349:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0d9f977a00/0xc6b31a1b598eafb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee7e2 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740539.703877:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0d9f977a00/0xc6b31a1b598eafb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee7e2 expref: 7 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740539.703889:0:14349:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0d9f977a00/0xc6b31a1b598eafb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee7e2 expref: 7 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740539.703899:0:14349:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9f977a00, rc 0) 00000100:00100000:1.0:1790740539.704078:0:14349:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbe60d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dfd6896-73f9-47af-8d09-fc89b7bb7456+7:13734:x1877727133146880:12345-192.168.203.58@tcp:101:mount.lustre.0 Request processed in 267us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740539.704086:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 78 00000100:00100000:2.0:1790740539.709495:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740539.709568:0:14351:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133147008 00000100:00100000:3.0:1790740539.709596:0:14351:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133147008 00000100:00100000:3.0:1790740539.709689:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 79 00000100:00100000:3.0:1790740539.709700:0:14351:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbe60e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dfd6896-73f9-47af-8d09-fc89b7bb7456+7:13734:x1877727133147008:12345-192.168.203.58@tcp:501:mount.lustre.0 00000100:00100000:3.0:1790740539.710197:0:14351:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbe60e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dfd6896-73f9-47af-8d09-fc89b7bb7456+8:13734:x1877727133147008:12345-192.168.203.58@tcp:501:mount.lustre.0 Request processed in 496us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740539.710207:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 79 00000100:00100000:2.0:1790740539.714794:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740539.715082:0:14349:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133147136 00000100:00100000:1.0:1790740539.715093:0:14349:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133147136 00000100:00100000:1.0:1790740539.715151:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 80 00000100:00100000:1.0:1790740539.715160:0:14349:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbe60f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dfd6896-73f9-47af-8d09-fc89b7bb7456+8:13734:x1877727133147136:12345-192.168.203.58@tcp:503:mount.lustre.0 00000100:00100000:1.0:1790740539.716592:0:14349:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbe60f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dfd6896-73f9-47af-8d09-fc89b7bb7456+8:13734:x1877727133147136:12345-192.168.203.58@tcp:503:mount.lustre.0 Request processed in 1406us (1779us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740539.716603:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 80 00000100:00100000:1.0:1790740539.725833:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740539.725931:0:14351:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133147264 00000100:00100000:3.0:1790740539.725941:0:14351:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133147264 00000100:00100000:3.0:1790740539.726001:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 81 00000100:00100000:3.0:1790740539.726011:0:14351:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbe60d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dfd6896-73f9-47af-8d09-fc89b7bb7456+8:13753:x1877727133147264:12345-192.168.203.58@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790740539.726609:0:14351:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbe60d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dfd6896-73f9-47af-8d09-fc89b7bb7456+8:13753:x1877727133147264:12345-192.168.203.58@tcp:502:llog_process_th.0 Request processed in 550us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740539.726619:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 81 00000100:00100000:2.0:1790740539.764034:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740539.764120:0:14349:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133147392 00000100:00100000:1.0:1790740539.764131:0:14349:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133147392 00000100:00100000:1.0:1790740539.764195:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 82 00000100:00100000:1.0:1790740539.764206:0:14349:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbe60e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dfd6896-73f9-47af-8d09-fc89b7bb7456+8:13753:x1877727133147392:12345-192.168.203.58@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790740539.764541:0:14349:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbe60e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dfd6896-73f9-47af-8d09-fc89b7bb7456+8:13753:x1877727133147392:12345-192.168.203.58@tcp:502:llog_process_th.0 Request processed in 334us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740539.764550:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 82 00000100:00100000:2.0:1790740539.778509:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740539.778701:0:14350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133147520 00000100:00100000:0.0:1790740539.778711:0:14350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133147520 00000100:00100000:0.0:1790740539.778767:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 83 00000100:00100000:0.0:1790740539.778777:0:14350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbe60d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dfd6896-73f9-47af-8d09-fc89b7bb7456+8:13734:x1877727133147520:12345-192.168.203.58@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790740539.778796:0:14350:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740539.778825:0:14350:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0dc132f800/0xc6b31a1b598eafc0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee80c expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740539.778856:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0dc132f800/0xc6b31a1b598eafc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee80c expref: 9 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740539.778867:0:14350:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0dc132f800/0xc6b31a1b598eafc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee80c expref: 9 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740539.778875:0:14350:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0dc132f800, rc 0) 00000100:00100000:0.0:1790740539.778935:0:14350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbe60d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dfd6896-73f9-47af-8d09-fc89b7bb7456+9:13734:x1877727133147520:12345-192.168.203.58@tcp:101:mount.lustre.0 Request processed in 159us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740539.778942:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 83 00000100:00100000:1.0:1790740539.782769:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740539.783112:0:14351:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133147648 00000100:00100000:2.0:1790740539.783122:0:14351:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133147648 00000100:00100000:2.0:1790740539.783191:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 84 00000100:00100000:2.0:1790740539.783200:0:14351:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbe60f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dfd6896-73f9-47af-8d09-fc89b7bb7456+9:13734:x1877727133147648:12345-192.168.203.58@tcp:256:mount.lustre.0 20000000:01000000:2.0:1790740539.783239:0:14351:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1790740539.783257:0:14351:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1790740539.783261:0:14351:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1790740539.783265:0:14351:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1790740539.783267:0:14351:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1790740539.792425:0:14351:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbe60f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dfd6896-73f9-47af-8d09-fc89b7bb7456+9:13734:x1877727133147648:12345-192.168.203.58@tcp:256:mount.lustre.0 Request processed in 9216us (9655us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740539.792451:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 84 00000100:00100000:3.0:1790740539.799030:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740539.799123:0:14349:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133147776 00000100:00100000:1.0:1790740539.799132:0:14349:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133147776 00000100:00100000:1.0:1790740539.799194:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 85 00000100:00100000:1.0:1790740539.799204:0:14349:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbe60c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dfd6896-73f9-47af-8d09-fc89b7bb7456+9:13734:x1877727133147776:12345-192.168.203.58@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790740539.799220:0:14349:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740539.799237:0:14349:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0d9f977600/0xc6b31a1b598eafc7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee813 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740539.799264:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0d9f977600/0xc6b31a1b598eafc7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee813 expref: 10 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740539.799276:0:14349:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0d9f977600/0xc6b31a1b598eafc7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee813 expref: 10 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740539.799284:0:14349:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9f977600, rc 0) 00000100:00100000:1.0:1790740539.799358:0:14349:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbe60c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dfd6896-73f9-47af-8d09-fc89b7bb7456+10:13734:x1877727133147776:12345-192.168.203.58@tcp:101:mount.lustre.0 Request processed in 156us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740539.799366:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 85 00000100:00100000:1.0:1790740539.807058:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740539.807123:0:14351:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133147904 00000100:00100000:3.0:1790740539.807134:0:14351:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133147904 00000100:00100000:3.0:1790740539.807189:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 86 00000100:00100000:3.0:1790740539.807199:0:14351:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbe60fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dfd6896-73f9-47af-8d09-fc89b7bb7456+10:13734:x1877727133147904:12345-192.168.203.58@tcp:501:mount.lustre.0 00000100:00100000:3.0:1790740539.807502:0:14351:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbe60fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dfd6896-73f9-47af-8d09-fc89b7bb7456+10:13734:x1877727133147904:12345-192.168.203.58@tcp:501:mount.lustre.0 Request processed in 304us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740539.807511:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 86 00000100:00100000:2.0:1790740539.815617:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740539.815695:0:14350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133148032 00000100:00100000:0.0:1790740539.815726:0:14350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133148032 00000100:00100000:0.0:1790740539.815779:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 87 00000100:00100000:0.0:1790740539.815790:0:14350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbe60ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dfd6896-73f9-47af-8d09-fc89b7bb7456+10:13734:x1877727133148032:12345-192.168.203.58@tcp:503:mount.lustre.0 00000100:00100000:0.0:1790740539.816535:0:14350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbe60ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dfd6896-73f9-47af-8d09-fc89b7bb7456+10:13734:x1877727133148032:12345-192.168.203.58@tcp:503:mount.lustre.0 Request processed in 745us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740539.816544:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 87 00000100:00100000:2.0:1790740539.830971:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740539.831427:0:14349:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133148160 00000100:00100000:1.0:1790740539.831438:0:14349:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133148160 00000100:00100000:1.0:1790740539.831493:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 88 00000100:00100000:1.0:1790740539.831503:0:14349:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbe60e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dfd6896-73f9-47af-8d09-fc89b7bb7456+10:13757:x1877727133148160:12345-192.168.203.58@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790740539.832099:0:14349:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbe60e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dfd6896-73f9-47af-8d09-fc89b7bb7456+10:13757:x1877727133148160:12345-192.168.203.58@tcp:502:llog_process_th.0 Request processed in 594us (1134us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740539.832108:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 88 00000100:00100000:1.0:1790740539.837648:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740539.837731:0:14350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133148288 00000100:00100000:0.0:1790740539.837742:0:14350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133148288 00000100:00100000:0.0:1790740539.837793:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 89 00000100:00100000:0.0:1790740539.837802:0:14350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbe60cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dfd6896-73f9-47af-8d09-fc89b7bb7456+10:13757:x1877727133148288:12345-192.168.203.58@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790740539.838073:0:14350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbe60cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dfd6896-73f9-47af-8d09-fc89b7bb7456+10:13757:x1877727133148288:12345-192.168.203.58@tcp:502:llog_process_th.0 Request processed in 271us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740539.838081:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 89 00000100:00100000:2.0:1790740539.854131:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740539.854238:0:14358:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133148416 00000100:00100000:3.0:1790740539.854250:0:14358:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133148416 00000100:00100000:3.0:1790740539.854313:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 4 00000100:00100000:3.0:1790740539.854322:0:14358:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd7d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2368:x1877727133148416:12345-192.168.203.58@tcp:38:mount.lustre.0 00010000:00080000:3.0:1790740539.854352:0:14358:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 94f64522-bacd-439b-9eb0-785368ef5e14@192.168.203.58@tcp t0 exp 0000000000000000 cur 455 last 0 00000020:00000080:3.0:1790740539.854457:0:14358:0:(genops.c:1384:class_connect()) connect: client 94f64522-bacd-439b-9eb0-785368ef5e14, cookie 0xc6b31a1b598eafce 00000004:00100000:3.0:1790740539.854490:0:14358:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1790740539.854496:0:14358:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:3.0:1790740539.895661:0:14358:0:(import.c:65:import_set_state_nolock()) ffff8f0db7a36800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790740539.895729:0:14358:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd7d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:94f64522-bacd-439b-9eb0-785368ef5e14+6:2368:x1877727133148416:12345-192.168.203.58@tcp:38:mount.lustre.0 Request processed in 41406us (41608us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740539.895741:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 4 00000100:00100000:2.0:1790740539.904506:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740539.904625:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740539.905223:0:14356:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133148672 00000100:00100000:0.0:1790740539.905234:0:14356:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133148672 00000100:00100000:0.0:1790740539.905310:0:14356:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133148544 00000100:00100000:0.0:1790740539.905314:0:14356:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133148544 00000100:00100000:0.0:1790740539.905333:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 5 00000100:00100000:0.0:1790740539.905342:0:14356:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd7d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:94f64522-bacd-439b-9eb0-785368ef5e14+7:13734:x1877727133148672:12345-192.168.203.58@tcp:41:mount.lustre.0 00000100:00080000:1.0:1790740539.905556:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:0.0:1790740539.905695:0:14356:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1790740539.905911:0:14356:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd7d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:94f64522-bacd-439b-9eb0-785368ef5e14+7:13734:x1877727133148672:12345-192.168.203.58@tcp:41:mount.lustre.0 Request processed in 568us (1413us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740539.905986:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 5 00000100:00100000:0.0:1790740539.906009:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 6 00000100:00100000:0.0:1790740539.906017:0:14356:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd7d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:94f64522-bacd-439b-9eb0-785368ef5e14+6:0:x1877727133148544:12345-192.168.203.58@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790740539.906045:0:14356:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1790740539.906073:0:14356:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd7d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:94f64522-bacd-439b-9eb0-785368ef5e14+6:0:x1877727133148544:12345-192.168.203.58@tcp:41:mount.lustre.0 Request processed in 57us (1448us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740539.906079:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 6 00000100:00100000:0.0:1790740539.908105:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740539.908238:0:14358:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133148800 00000100:00100000:2.0:1790740539.908247:0:14358:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133148800 00000100:00100000:2.0:1790740539.908303:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 7 00000100:00100000:2.0:1790740539.908312:0:14358:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1b40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:94f64522-bacd-439b-9eb0-785368ef5e14+6:13734:x1877727133148800:12345-192.168.203.58@tcp:40:mount.lustre.0 00000100:00100000:2.0:1790740539.908393:0:14358:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1b40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:94f64522-bacd-439b-9eb0-785368ef5e14+6:13734:x1877727133148800:12345-192.168.203.58@tcp:40:mount.lustre.0 Request processed in 82us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740539.908401:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 7 00000100:00100000:2.0:1790740539.916020:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740539.916107:0:15041:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133148928 00000100:00100000:0.0:1790740539.916117:0:15041:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133148928 00000100:00100000:0.0:1790740539.916163:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 8 00000100:00100000:0.0:1790740539.916170:0:15041:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd7d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2368:x1877727133148928:12345-192.168.203.58@tcp:8:mount.lustre.0 00010000:00080000:0.0:1790740539.916200:0:15041:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 94f64522-bacd-439b-9eb0-785368ef5e14@192.168.203.58@tcp t0 exp 0000000000000000 cur 455 last 0 00000020:00000080:0.0:1790740539.916228:0:15041:0:(genops.c:1384:class_connect()) connect: client 94f64522-bacd-439b-9eb0-785368ef5e14, cookie 0xc6b31a1b598eafd5 00002000:00100000:0.0:1790740539.916241:0:15041:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 94f64522-bacd-439b-9eb0-785368ef5e14/ffff8f0c84e4d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790740539.916265:0:15041:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790740539.916754:0:15041:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1790740539.916786:0:15041:0:(import.c:65:import_set_state_nolock()) ffff8f0c84e4d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790740539.917109:0:15041:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd7d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:94f64522-bacd-439b-9eb0-785368ef5e14+6:2368:x1877727133148928:12345-192.168.203.58@tcp:8:mount.lustre.0 Request processed in 936us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740539.917117:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 8 00000100:00100000:3.0:1790740539.919191:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740539.919347:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740539.919622:0:14359:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133149184 00000100:00100000:0.0:1790740539.919631:0:14359:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133149184 00000100:00100000:0.0:1790740539.919683:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 0 00000100:00100000:0.0:1790740539.919693:0:14359:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db57a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:94f64522-bacd-439b-9eb0-785368ef5e14+6:13734:x1877727133149184:12345-192.168.203.58@tcp:33:mount.lustre.0 00000004:00080000:3.0:1790740539.921086:0:14359:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1297us 00000100:00100000:2.0:1790740539.924021:0:15044:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133149056 00000100:00100000:2.0:1790740539.924034:0:15044:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133149056 00000100:00100000:2.0:1790740539.924845:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 9 00000100:00100000:2.0:1790740539.924855:0:15044:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db57aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2368:x1877727133149056:12345-192.168.203.58@tcp:8:mount.lustre.0 00010000:00080000:2.0:1790740539.924885:0:15044:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 94f64522-bacd-439b-9eb0-785368ef5e14@192.168.203.58@tcp t0 exp 0000000000000000 cur 455 last 0 00000020:00000080:2.0:1790740539.924918:0:15044:0:(genops.c:1384:class_connect()) connect: client 94f64522-bacd-439b-9eb0-785368ef5e14, cookie 0xc6b31a1b598eafdc 00002000:00100000:2.0:1790740539.924928:0:15044:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 94f64522-bacd-439b-9eb0-785368ef5e14/ffff8f0db5714000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790740539.924951:0:15044:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790740539.925594:0:15044:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790740539.925625:0:15044:0:(import.c:65:import_set_state_nolock()) ffff8f0db5711800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790740539.925703:0:15044:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db57aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:94f64522-bacd-439b-9eb0-785368ef5e14+6:2368:x1877727133149056:12345-192.168.203.58@tcp:8:mount.lustre.0 Request processed in 847us (6517us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740539.925712:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 9 00000004:00200000:0.0:1790740539.963768:0:14359:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1790740539.963881:0:14359:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db57a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:94f64522-bacd-439b-9eb0-785368ef5e14+6:13734:x1877727133149184:12345-192.168.203.58@tcp:33:mount.lustre.0 Request processed in 44184us (44529us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740539.963901:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 0 00000100:00100000:3.0:1790740540.208993:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db57a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158307584:0@lo:400:kworker.0 00000100:00100000:3.0:1790740540.209072:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740540.209309:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db57ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877727158307840:0@lo:400:kworker.0 00000100:00100000:1.0:1790740540.209343:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740540.209370:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db57a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158307712:0@lo:400:kworker.0 00000100:00100000:1.0:1790740540.209392:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740540.209591:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db57a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:752c79c8-24e4-410a-832f-aac51b94c085:3303:1877727158307456:0@lo:400:kworker.0 00000100:00100000:2.0:1790740540.209625:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740540.211680:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db57a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1877727158308096:0@lo:400:kworker.0 00000100:00100000:3.0:1790740540.211765:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740540.211842:0:15041:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158307584 00000100:00100000:3.0:1790740540.211850:0:15041:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158307584 00000100:00100000:3.0:1790740540.211902:0:15041:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158307712 00000100:00100000:3.0:1790740540.211905:0:15041:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158307712 00000100:00100000:3.0:1790740540.211927:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790740540.211936:0:15041:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d9018c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158307584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740540.211990:0:15041:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d9018c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158307584:12345-0@lo:400:kworker.0 Request processed in 55us (2917us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740540.211996:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790740540.212015:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790740540.212021:0:15041:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3305:x1877727158307712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740540.212047:0:15041:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3305:x1877727158307712:12345-0@lo:400:kworker.0 Request processed in 28us (2655us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740540.212052:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1790740540.212069:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790740540.212072:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790740540.212081:0:14357:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158307840 00000100:00100000:3.0:1790740540.212086:0:14357:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158307840 00000100:00100000:3.0:1790740540.212109:0:14357:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158308096 00000100:00100000:3.0:1790740540.212112:0:14357:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158308096 00000100:00100000:3.0:1790740540.212127:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790740540.212132:0:14357:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877727158307840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740540.212162:0:14357:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877727158307840:12345-0@lo:400:kworker.0 Request processed in 30us (2818us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740540.212184:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790740540.212200:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790740540.212205:0:14357:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d9018df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1877727158308096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740540.212250:0:14357:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d9018df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1877727158308096:12345-0@lo:400:kworker.0 Request processed in 45us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740540.212257:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1790740540.212275:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790740540.212316:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db57a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158307584:0@lo:400:kworker.0 00010000:00080000:3.0:1790740540.212330:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0db57a9180 x1877727158308096/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740540.212340:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db57a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1877727158308096:0@lo:400:kworker.0 00010000:00080000:3.0:1790740540.212395:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0db57ab480 x1877727158307840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790740540.212405:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db57ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877727158307840:0@lo:400:kworker.0 00000100:00100000:3.0:1790740540.212416:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790740540.212422:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd7d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158308224:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790740540.213483:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740540.214065:0:14349:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158307456 00000100:00100000:0.0:1790740540.214074:0:14349:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158307456 00000100:00100000:0.0:1790740540.214117:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1790740540.214124:0:14349:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbe60f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:752c79c8-24e4-410a-832f-aac51b94c085+19:3303:x1877727158307456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740540.214180:0:14349:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbe60f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:752c79c8-24e4-410a-832f-aac51b94c085+19:3303:x1877727158307456:12345-0@lo:400:kworker.0 Request processed in 57us (4554us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740540.214187:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1790740540.214246:0:15046:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158308224 00000100:00100000:0.0:1790740540.214250:0:15046:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158308224 00000100:00100000:0.0:1790740540.214272:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790740540.214279:0:15046:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d9018f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1877727158308224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790740540.214303:0:15046:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790740540.214488:0:15046:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d9018f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1877727158308224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 209us (1007us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740540.214495:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790740540.223980:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db57a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:752c79c8-24e4-410a-832f-aac51b94c085:3303:1877727158307456:0@lo:400:kworker.0 00000100:00100000:2.0:1790740540.223999:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db57aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1877727158307968:0@lo:400:kworker.0 00000100:00100000:2.0:1790740540.224064:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740540.224131:0:14357:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158307968 00000100:00100000:2.0:1790740540.224137:0:14357:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158307968 00000100:00100000:2.0:1790740540.224190:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790740540.224198:0:14357:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd7d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1877727158307968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740540.226632:0:14357:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd7d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1877727158307968:12345-0@lo:400:kworker.0 Request processed in 2425us (2557us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740540.226647:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790740540.228208:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db57a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158307712:0@lo:400:kworker.0 00000100:00080000:2.0:1790740540.228560:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1790740540.228675:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0db57aa300 x1877727158307968/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790740556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790740540.228687:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db57aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1877727158307968:0@lo:400:kworker.0 00000100:00100000:2.0:1790740540.236626:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd7d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158308224:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790740540.276636:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740540.276682:0:14358:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133149312 00000100:00100000:1.0:1790740540.276692:0:14358:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133149312 00000100:00100000:1.0:1790740540.278428:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 8 00000100:00100000:1.0:1790740540.279074:0:14358:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:94f64522-bacd-439b-9eb0-785368ef5e14+6:13778:x1877727133149312:12345-192.168.203.58@tcp:101:mkdir.0 00010000:00010000:1.0:1790740540.279099:0:14358:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740540.279125:0:14358:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976400/0xc6b31a1b598eafe3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee83d expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740540.279193:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977c00/0xc6b31a1b598eafea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740540.279208:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977c00/0xc6b31a1b598eafea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740540.280194:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977c00/0xc6b31a1b598eafea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790740540.280241:0:14358:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790740540.280245:0:14358:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790740540.280296:0:14358:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977c00/0xc6b31a1b598eafea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740540.280325:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976400/0xc6b31a1b598eafe3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee83d expref: 8 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740540.280344:0:14358:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977c00/0xc6b31a1b598eafea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee83d expref: 7 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740540.280353:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0d84a1e200) 00010000:00010000:1.0:1790740540.280356:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790740540.280359:0:14358:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9f977c00, rc 0) 00000100:00100000:1.0:1790740540.280432:0:14358:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:94f64522-bacd-439b-9eb0-785368ef5e14+7:13778:x1877727133149312:12345-192.168.203.58@tcp:101:mkdir.0 Request processed in 1992us (3805us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740540.280450:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 8 00000001:00100000:2.0:1790740540.311038:0:7642:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1790740540.311052:0:7642:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 94f64522-bacd-439b-9eb0-785368ef5e14 00000001:00080000:2.0:1790740540.311065:0:7642:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:3.0:1790740540.721064:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740541.748744:0:15644:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1790740541.817487:0:6725:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 94f64522-bacd-439b-9eb0-785368ef5e14 00000100:00100000:1.0:1790740542.593908:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740542.594051:0:14356:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133149440 00000100:00100000:2.0:1790740542.594061:0:14356:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133149440 00000100:00100000:2.0:1790740542.594149:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 9 00000100:00100000:2.0:1790740542.594160:0:14356:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:94f64522-bacd-439b-9eb0-785368ef5e14+7:13830:x1877727133149440:12345-192.168.203.58@tcp:41:lfs.0 00000004:00000024:2.0:1790740542.594206:0:14356:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00080000:3.0:1790740542.594247:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790740542.594314:0:14356:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:94f64522-bacd-439b-9eb0-785368ef5e14+7:13830:x1877727133149440:12345-192.168.203.58@tcp:41:lfs.0 Request processed in 156us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740542.594321:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 9 00000100:00100000:3.0:1790740542.606044:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740542.606173:0:15046:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133149568 00000100:00100000:0.0:1790740542.606183:0:15046:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133149568 00000100:00100000:0.0:1790740542.606260:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 5 00000100:00100000:0.0:1790740542.606281:0:15046:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d9018ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:94f64522-bacd-439b-9eb0-785368ef5e14+5:13830:x1877727133149568:12345-192.168.203.58@tcp:13:lfs.0 00002000:00000024:0.0:1790740542.606317:0:15046:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1790740542.606383:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790740542.606403:0:15046:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d9018ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:94f64522-bacd-439b-9eb0-785368ef5e14+5:13830:x1877727133149568:12345-192.168.203.58@tcp:13:lfs.0 Request processed in 134us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740542.606411:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 5 00000100:00100000:1.0:1790740542.609048:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740542.609353:0:15045:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133149696 00000100:00100000:0.0:1790740542.609363:0:15045:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133149696 00000100:00100000:0.0:1790740542.609431:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 6 00000100:00100000:0.0:1790740542.609451:0:15045:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:94f64522-bacd-439b-9eb0-785368ef5e14+5:13830:x1877727133149696:12345-192.168.203.58@tcp:13:lfs.0 00002000:00000024:0.0:1790740542.609488:0:15045:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790740542.609600:0:15045:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:94f64522-bacd-439b-9eb0-785368ef5e14+5:13830:x1877727133149696:12345-192.168.203.58@tcp:13:lfs.0 Request processed in 133us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740542.609608:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 6 00000100:00080000:3.0:1790740542.609945:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1790740542.768726:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740542.769143:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790740542.769165:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1b41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158308352:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790740542.769230:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740542.773597:0:15045:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158308352 00000100:00100000:0.0:1790740542.773610:0:15045:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158308352 00000100:00100000:0.0:1790740542.774084:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790740542.774096:0:15045:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158308352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790740542.774124:0:15045:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790740542.774215:0:15045:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158308352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (4983us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740542.774222:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790740542.774429:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1b41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158308352:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1790740542.774957:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790740543.049379:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740543.049465:0:14351:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133149824 00000100:00100000:3.0:1790740543.049475:0:14351:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133149824 00000100:00100000:3.0:1790740543.049529:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 91 00000100:00100000:3.0:1790740543.049538:0:14351:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbe60c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dfd6896-73f9-47af-8d09-fc89b7bb7456+10:13863:x1877727133149824:12345-192.168.203.58@tcp:101:mount.lustre.0 00010000:00010000:3.0:1790740543.049554:0:14351:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740543.049594:0:14351:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0db6c0fa00/0xc6b31a1b598eaff1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee844 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740543.049624:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0db6c0fa00/0xc6b31a1b598eaff1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee844 expref: 11 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740543.049635:0:14351:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0db6c0fa00/0xc6b31a1b598eaff1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee844 expref: 11 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740543.049644:0:14351:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0db6c0fa00, rc 0) 00000100:00100000:3.0:1790740543.049710:0:14351:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbe60c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dfd6896-73f9-47af-8d09-fc89b7bb7456+11:13863:x1877727133149824:12345-192.168.203.58@tcp:101:mount.lustre.0 Request processed in 172us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740543.049718:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 91 00000100:00100000:2.0:1790740543.062952:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740543.063121:0:14350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133149952 00000100:00100000:0.0:1790740543.063131:0:14350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133149952 00000100:00100000:0.0:1790740543.063190:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 92 00000100:00100000:0.0:1790740543.063200:0:14350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbe8f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dfd6896-73f9-47af-8d09-fc89b7bb7456+11:13863:x1877727133149952:12345-192.168.203.58@tcp:501:mount.lustre.0 00000100:00100000:0.0:1790740543.063512:0:14350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbe8f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dfd6896-73f9-47af-8d09-fc89b7bb7456+11:13863:x1877727133149952:12345-192.168.203.58@tcp:501:mount.lustre.0 Request processed in 312us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740543.063521:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 92 00000100:00100000:1.0:1790740543.077753:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740543.077985:0:14351:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133150080 00000100:00100000:3.0:1790740543.077996:0:14351:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133150080 00000100:00100000:3.0:1790740543.078049:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 93 00000100:00100000:3.0:1790740543.078060:0:14351:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbe8f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dfd6896-73f9-47af-8d09-fc89b7bb7456+11:13863:x1877727133150080:12345-192.168.203.58@tcp:503:mount.lustre.0 00000100:00100000:3.0:1790740543.078369:0:14351:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbe8f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dfd6896-73f9-47af-8d09-fc89b7bb7456+11:13863:x1877727133150080:12345-192.168.203.58@tcp:503:mount.lustre.0 Request processed in 311us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740543.078377:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 93 00000100:00100000:1.0:1790740543.094313:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740543.094652:0:14350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133150208 00000100:00100000:0.0:1790740543.094662:0:14350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133150208 00000100:00100000:0.0:1790740543.094726:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 94 00000100:00100000:0.0:1790740543.094736:0:14350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbe8fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dfd6896-73f9-47af-8d09-fc89b7bb7456+11:13868:x1877727133150208:12345-192.168.203.58@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790740543.095096:0:14350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbe8fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dfd6896-73f9-47af-8d09-fc89b7bb7456+11:13868:x1877727133150208:12345-192.168.203.58@tcp:502:llog_process_th.0 Request processed in 361us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740543.095105:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 94 00000100:00100000:2.0:1790740543.148664:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740543.148827:0:14349:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133150336 00000100:00100000:1.0:1790740543.148837:0:14349:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133150336 00000100:00100000:1.0:1790740543.148894:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 95 00000100:00100000:1.0:1790740543.148904:0:14349:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbe8f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dfd6896-73f9-47af-8d09-fc89b7bb7456+11:13868:x1877727133150336:12345-192.168.203.58@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790740543.149180:0:14349:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbe8f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dfd6896-73f9-47af-8d09-fc89b7bb7456+11:13868:x1877727133150336:12345-192.168.203.58@tcp:502:llog_process_th.0 Request processed in 277us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740543.149189:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 95 00000100:00100000:1.0:1790740543.160899:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740543.161137:0:14351:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133150464 00000100:00100000:3.0:1790740543.161146:0:14351:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133150464 00000100:00100000:3.0:1790740543.161198:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 96 00000100:00100000:3.0:1790740543.161222:0:14351:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbe8fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dfd6896-73f9-47af-8d09-fc89b7bb7456+11:13863:x1877727133150464:12345-192.168.203.58@tcp:101:mount.lustre.0 00010000:00010000:3.0:1790740543.161240:0:14351:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740543.161256:0:14351:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0db6c0e000/0xc6b31a1b598eaff8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee86e expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740543.161295:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0db6c0e000/0xc6b31a1b598eaff8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee86e expref: 12 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740543.161307:0:14351:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0db6c0e000/0xc6b31a1b598eaff8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee86e expref: 12 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740543.161316:0:14351:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0db6c0e000, rc 0) 00000100:00100000:3.0:1790740543.161367:0:14351:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbe8fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dfd6896-73f9-47af-8d09-fc89b7bb7456+12:13863:x1877727133150464:12345-192.168.203.58@tcp:101:mount.lustre.0 Request processed in 148us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740543.161374:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 96 00000100:00100000:2.0:1790740543.179244:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740543.179335:0:14350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133150592 00000100:00100000:0.0:1790740543.179345:0:14350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133150592 00000100:00100000:0.0:1790740543.179392:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 97 00000100:00100000:0.0:1790740543.179401:0:14350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbe8fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dfd6896-73f9-47af-8d09-fc89b7bb7456+12:13863:x1877727133150592:12345-192.168.203.58@tcp:256:mount.lustre.0 20000000:01000000:0.0:1790740543.179432:0:14350:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1790740543.179456:0:14350:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1790740543.179460:0:14350:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1790740543.179464:0:14350:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1790740543.179466:0:14350:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1790740543.186022:0:14350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbe8fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dfd6896-73f9-47af-8d09-fc89b7bb7456+12:13863:x1877727133150592:12345-192.168.203.58@tcp:256:mount.lustre.0 Request processed in 6612us (6776us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740543.186037:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 97 00000100:00100000:1.0:1790740543.189402:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740543.189618:0:14349:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133150720 00000100:00100000:0.0:1790740543.189627:0:14349:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133150720 00000100:00100000:0.0:1790740543.189682:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 98 00000100:00100000:0.0:1790740543.189691:0:14349:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbe8fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dfd6896-73f9-47af-8d09-fc89b7bb7456+12:13863:x1877727133150720:12345-192.168.203.58@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790740543.189708:0:14349:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740543.189725:0:14349:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0dc132f600/0xc6b31a1b598eafff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee875 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740543.189754:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0dc132f600/0xc6b31a1b598eafff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee875 expref: 13 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740543.189765:0:14349:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0dc132f600/0xc6b31a1b598eafff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee875 expref: 13 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740543.189785:0:14349:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0dc132f600, rc 0) 00000100:00100000:0.0:1790740543.190456:0:14349:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbe8fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dfd6896-73f9-47af-8d09-fc89b7bb7456+13:13863:x1877727133150720:12345-192.168.203.58@tcp:101:mount.lustre.0 Request processed in 762us (1059us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740543.190465:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 98 00000100:00100000:2.0:1790740543.197086:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740543.197457:0:14350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133150848 00000100:00100000:0.0:1790740543.197467:0:14350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133150848 00000100:00100000:0.0:1790740543.197569:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 99 00000100:00100000:0.0:1790740543.197615:0:14350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbe8fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dfd6896-73f9-47af-8d09-fc89b7bb7456+13:13863:x1877727133150848:12345-192.168.203.58@tcp:501:mount.lustre.0 00000100:00100000:0.0:1790740543.197896:0:14350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbe8fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dfd6896-73f9-47af-8d09-fc89b7bb7456+13:13863:x1877727133150848:12345-192.168.203.58@tcp:501:mount.lustre.0 Request processed in 283us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740543.197904:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 99 00000100:00100000:3.0:1790740543.201405:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740543.207924:0:14349:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133150976 00000100:00100000:1.0:1790740543.207940:0:14349:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133150976 00000100:00100000:1.0:1790740543.208015:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 100 00000100:00100000:1.0:1790740543.208027:0:14349:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbe8fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dfd6896-73f9-47af-8d09-fc89b7bb7456+13:13863:x1877727133150976:12345-192.168.203.58@tcp:503:mount.lustre.0 00000100:00100000:1.0:1790740543.208311:0:14349:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbe8fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dfd6896-73f9-47af-8d09-fc89b7bb7456+13:13863:x1877727133150976:12345-192.168.203.58@tcp:503:mount.lustre.0 Request processed in 286us (6913us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740543.208319:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 100 00000100:00100000:1.0:1790740543.218021:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740543.218269:0:14349:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133151104 00000100:00100000:0.0:1790740543.218280:0:14349:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133151104 00000100:00100000:0.0:1790740543.218424:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 101 00000100:00100000:0.0:1790740543.218435:0:14349:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbe8fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dfd6896-73f9-47af-8d09-fc89b7bb7456+13:13872:x1877727133151104:12345-192.168.203.58@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790740543.219663:0:14349:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbe8fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dfd6896-73f9-47af-8d09-fc89b7bb7456+13:13872:x1877727133151104:12345-192.168.203.58@tcp:502:llog_process_th.0 Request processed in 1227us (1647us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740543.219673:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 101 00000100:00100000:2.0:1790740543.239092:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740543.239205:0:14350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133151232 00000100:00100000:0.0:1790740543.239215:0:14350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133151232 00000100:00100000:0.0:1790740543.239275:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 102 00000100:00100000:0.0:1790740543.239285:0:14350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbe8f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dfd6896-73f9-47af-8d09-fc89b7bb7456+13:13872:x1877727133151232:12345-192.168.203.58@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790740543.239706:0:14350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbe8f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dfd6896-73f9-47af-8d09-fc89b7bb7456+13:13872:x1877727133151232:12345-192.168.203.58@tcp:502:llog_process_th.0 Request processed in 420us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740543.239723:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 102 00000100:00100000:3.0:1790740543.252254:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740543.252302:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740543.252333:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740543.252370:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740543.252405:0:16022:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133152000 00000100:00100000:3.0:1790740543.252416:0:16022:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133152000 00000100:00100000:3.0:1790740543.252462:0:16022:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133151872 00000100:00100000:3.0:1790740543.252465:0:16022:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133151872 00000100:00100000:3.0:1790740543.252487:0:16022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 4 00000100:00100000:3.0:1790740543.252496:0:16022:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d9018d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:94f64522-bacd-439b-9eb0-785368ef5e14+5:2370:x1877727133152000:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:3.0:1790740543.252565:0:16022:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d9018d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:94f64522-bacd-439b-9eb0-785368ef5e14+5:2370:x1877727133152000:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 69us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740543.252620:0:16022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 4 00000100:00100000:3.0:1790740543.252640:0:16022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 5 00000100:00100000:3.0:1790740543.252662:0:16022:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d9018c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:94f64522-bacd-439b-9eb0-785368ef5e14+5:2370:x1877727133151872:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:3.0:1790740543.252699:0:16022:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d9018c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:94f64522-bacd-439b-9eb0-785368ef5e14+5:2370:x1877727133151872:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 53us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740543.252705:0:16022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 5 00000100:00100000:2.0:1790740543.253008:0:14356:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133151360 00000100:00100000:2.0:1790740543.253013:0:14356:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133151360 00000100:00100000:2.0:1790740543.253042:0:14356:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133151744 00000100:00100000:2.0:1790740543.253044:0:14356:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133151744 00000100:00100000:2.0:1790740543.253062:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 16 00000100:00100000:2.0:1790740543.253068:0:14356:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d9018dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:94f64522-bacd-439b-9eb0-785368ef5e14+7:2370:x1877727133151744:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:2.0:1790740543.253101:0:14356:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d9018dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:94f64522-bacd-439b-9eb0-785368ef5e14+7:2370:x1877727133151744:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 33us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740543.253117:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 16 00000100:00100000:2.0:1790740543.253131:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 10 00000100:00100000:2.0:1790740543.253135:0:14356:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d9018d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2368:x1877727133151360:12345-192.168.203.58@tcp:38:mount.lustre.0 00010000:00080000:2.0:1790740543.253155:0:14356:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 1afbbc59-4fef-403d-8587-7e85da474903@192.168.203.58@tcp t0 exp 0000000000000000 cur 459 last 0 00000020:00000080:2.0:1790740543.253198:0:14356:0:(genops.c:1384:class_connect()) connect: client 1afbbc59-4fef-403d-8587-7e85da474903, cookie 0xc6b31a1b598eb006 00000004:00100000:2.0:1790740543.253227:0:14356:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1790740543.253358:0:14356:0:(import.c:65:import_set_state_nolock()) ffff8f0db5714800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790740543.253389:0:14356:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d9018d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1afbbc59-4fef-403d-8587-7e85da474903+6:2368:x1877727133151360:12345-192.168.203.58@tcp:38:mount.lustre.0 Request processed in 252us (1146us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740543.253397:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 10 00000100:00100000:3.0:1790740543.261967:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740543.262009:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740543.262344:0:14358:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133151616 00000100:00100000:1.0:1790740543.262355:0:14358:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133151616 00000100:00100000:1.0:1790740543.262431:0:14358:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133151488 00000100:00100000:1.0:1790740543.262434:0:14358:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133151488 00000100:00100000:1.0:1790740543.262461:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 11 00000100:00100000:1.0:1790740543.262469:0:14358:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d9018e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1afbbc59-4fef-403d-8587-7e85da474903+7:13863:x1877727133151616:12345-192.168.203.58@tcp:41:mount.lustre.0 00000004:00000024:1.0:1790740543.262514:0:14358:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1790740543.262615:0:14358:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d9018e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1afbbc59-4fef-403d-8587-7e85da474903+7:13863:x1877727133151616:12345-192.168.203.58@tcp:41:mount.lustre.0 Request processed in 145us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740543.262623:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 11 00000100:00100000:1.0:1790740543.262641:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 12 00000100:00100000:1.0:1790740543.262648:0:14358:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d9018fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1afbbc59-4fef-403d-8587-7e85da474903+6:0:x1877727133151488:12345-192.168.203.58@tcp:41:mount.lustre.0 00000004:00000024:1.0:1790740543.262659:0:14358:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:3.0:1790740543.262865:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790740543.264104:0:14358:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d9018fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1afbbc59-4fef-403d-8587-7e85da474903+6:0:x1877727133151488:12345-192.168.203.58@tcp:41:mount.lustre.0 Request processed in 35us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740543.264129:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 12 00000100:00100000:1.0:1790740543.265525:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740543.265667:0:14357:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133152128 00000100:00100000:0.0:1790740543.265677:0:14357:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133152128 00000100:00100000:0.0:1790740543.265738:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 13 00000100:00100000:0.0:1790740543.265748:0:14357:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1afbbc59-4fef-403d-8587-7e85da474903+6:13863:x1877727133152128:12345-192.168.203.58@tcp:40:mount.lustre.0 00000100:00100000:0.0:1790740543.265839:0:14357:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1afbbc59-4fef-403d-8587-7e85da474903+6:13863:x1877727133152128:12345-192.168.203.58@tcp:40:mount.lustre.0 Request processed in 93us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740543.265847:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 13 00000100:00100000:3.0:1790740543.271450:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740543.271526:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740543.271975:0:14360:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133152512 00000100:00100000:1.0:1790740543.271984:0:14360:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133152512 00000100:00100000:1.0:1790740543.272032:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 1 00000100:00100000:1.0:1790740543.272042:0:14360:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d9018ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1afbbc59-4fef-403d-8587-7e85da474903+6:13863:x1877727133152512:12345-192.168.203.58@tcp:33:mount.lustre.0 00000004:00200000:1.0:1790740543.272125:0:14360:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1790740543.272216:0:14360:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d9018ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1afbbc59-4fef-403d-8587-7e85da474903+6:13863:x1877727133152512:12345-192.168.203.58@tcp:33:mount.lustre.0 Request processed in 174us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740543.272224:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 1 00000100:00100000:0.0:1790740543.272445:0:16022:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133152256 00000100:00100000:0.0:1790740543.272451:0:16022:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133152256 00000100:00100000:0.0:1790740543.272484:0:16022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 10 00000100:00100000:0.0:1790740543.272489:0:16022:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d9018ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2368:x1877727133152256:12345-192.168.203.58@tcp:8:mount.lustre.0 00010000:00080000:0.0:1790740543.272510:0:16022:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 1afbbc59-4fef-403d-8587-7e85da474903@192.168.203.58@tcp t0 exp 0000000000000000 cur 459 last 0 00000020:00000080:0.0:1790740543.272539:0:16022:0:(genops.c:1384:class_connect()) connect: client 1afbbc59-4fef-403d-8587-7e85da474903, cookie 0xc6b31a1b598eb00d 00002000:00100000:0.0:1790740543.272550:0:16022:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1afbbc59-4fef-403d-8587-7e85da474903/ffff8f0d846e5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790740543.272559:0:16022:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790740543.272852:0:16022:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1790740543.272883:0:16022:0:(import.c:65:import_set_state_nolock()) ffff8f0d846e2000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790740543.272917:0:16022:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d9018ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1afbbc59-4fef-403d-8587-7e85da474903+6:2368:x1877727133152256:12345-192.168.203.58@tcp:8:mount.lustre.0 Request processed in 427us (1391us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740543.272930:0:16022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 10 00000100:00100000:0.0:1790740543.273476:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740543.277252:0:15043:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133152384 00000100:00100000:3.0:1790740543.277277:0:15043:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133152384 00000100:00100000:3.0:1790740543.277395:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 11 00000100:00100000:3.0:1790740543.277403:0:15043:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1b40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2368:x1877727133152384:12345-192.168.203.58@tcp:8:mount.lustre.0 00010000:00080000:3.0:1790740543.277435:0:15043:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 1afbbc59-4fef-403d-8587-7e85da474903@192.168.203.58@tcp t0 exp 0000000000000000 cur 459 last 0 00000020:00000080:3.0:1790740543.277473:0:15043:0:(genops.c:1384:class_connect()) connect: client 1afbbc59-4fef-403d-8587-7e85da474903, cookie 0xc6b31a1b598eb014 00002000:00100000:3.0:1790740543.277485:0:15043:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1afbbc59-4fef-403d-8587-7e85da474903/ffff8f0db7a37000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1790740543.277496:0:15043:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1790740543.277777:0:15043:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1790740543.279052:0:15043:0:(import.c:65:import_set_state_nolock()) ffff8f0db7a30000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790740543.279244:0:15043:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1b40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1afbbc59-4fef-403d-8587-7e85da474903+6:2368:x1877727133152384:12345-192.168.203.58@tcp:8:mount.lustre.0 Request processed in 1837us (5766us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740543.279254:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 11 00000100:00100000:2.0:1790740543.499994:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740543.500213:0:14356:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133152640 00000100:00100000:3.0:1790740543.500223:0:14356:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133152640 00000100:00100000:3.0:1790740543.500286:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 14 00000100:00100000:3.0:1790740543.500297:0:14356:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd7d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1afbbc59-4fef-403d-8587-7e85da474903+6:13893:x1877727133152640:12345-192.168.203.58@tcp:101:mkdir.0 00010000:00010000:3.0:1790740543.500317:0:14356:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740543.500339:0:14356:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f800/0xc6b31a1b598eb01b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee89f expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740543.500402:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ec00/0xc6b31a1b598eb022 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740543.500416:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ec00/0xc6b31a1b598eb022 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740543.500429:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ec00/0xc6b31a1b598eb022 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790740543.500462:0:14356:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790740543.500465:0:14356:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790740543.500487:0:14356:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ec00/0xc6b31a1b598eb022 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740543.500510:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f800/0xc6b31a1b598eb01b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee89f expref: 8 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740543.500530:0:14356:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ec00/0xc6b31a1b598eb022 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee89f expref: 7 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740543.500538:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0d84a1e200) 00010000:00010000:3.0:1790740543.500541:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790740543.500556:0:14356:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0db6c0ec00, rc 0) 00000100:00100000:3.0:1790740543.500666:0:14356:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd7d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1afbbc59-4fef-403d-8587-7e85da474903+7:13893:x1877727133152640:12345-192.168.203.58@tcp:101:mkdir.0 Request processed in 371us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740543.500673:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 14 00010000:00010000:3.0:1790740543.793333:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790740544.177593:0:14391:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790740544.821117:0:15644:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740545.330782:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158308480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790740545.330851:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740545.331947:0:15045:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158308480 00000100:00100000:0.0:1790740545.331957:0:15045:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158308480 00000100:00100000:0.0:1790740545.332028:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790740545.332037:0:15045:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158308480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790740545.332069:0:15045:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790740545.332131:0:15045:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158308480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (1280us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740545.332138:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1790740545.332860:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790740545.334657:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1790740545.335609:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158308480:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790740545.336007:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d9018d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158308736:0@lo:400:kworker.0 00000100:00100000:3.0:1790740545.336067:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740545.336095:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790740545.336100:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d9018f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877727158308864:0@lo:400:kworker.0 00000100:00100000:3.0:1790740545.336123:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740545.336153:0:16022:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158308736 00000100:00100000:3.0:1790740545.336160:0:16022:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158308736 00000100:00100000:3.0:1790740545.336210:0:16022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790740545.336218:0:16022:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d9018ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158308736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740545.336276:0:16022:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d9018ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158308736:12345-0@lo:400:kworker.0 Request processed in 58us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740545.336283:0:16022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790740545.336309:0:14358:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158308864 00000100:00100000:3.0:1790740545.336313:0:14358:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158308864 00000100:00100000:3.0:1790740545.336336:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790740545.336354:0:14358:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db57a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877727158308864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740545.336384:0:14358:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db57a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877727158308864:12345-0@lo:400:kworker.0 Request processed in 41us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740545.336390:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1790740545.336407:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790740545.336434:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d9018f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:752c79c8-24e4-410a-832f-aac51b94c085:3304:1877727158308608:0@lo:400:kworker.0 00000100:00100000:3.0:1790740545.336463:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740545.336515:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d9018c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1877727158309120:0@lo:400:kworker.0 00000100:00100000:3.0:1790740545.336537:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740545.336553:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790740545.336557:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d9018e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1877727158308992:0@lo:400:kworker.0 00000100:00100000:3.0:1790740545.336593:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740545.336614:0:14349:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158308608 00000100:00100000:3.0:1790740545.336618:0:14349:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158308608 00000100:00100000:3.0:1790740545.336639:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1790740545.336645:0:14349:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbe8f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:752c79c8-24e4-410a-832f-aac51b94c085+19:3304:x1877727158308608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740545.336687:0:14349:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbe8f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:752c79c8-24e4-410a-832f-aac51b94c085+19:3304:x1877727158308608:12345-0@lo:400:kworker.0 Request processed in 41us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740545.336693:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1790740545.336716:0:14357:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158309120 00000100:00100000:3.0:1790740545.336720:0:14357:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158309120 00000100:00100000:3.0:1790740545.336741:0:14357:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158308992 00000100:00100000:3.0:1790740545.336744:0:14357:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158308992 00000100:00100000:3.0:1790740545.336759:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790740545.336764:0:14357:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db57aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1877727158309120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740545.336793:0:14357:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db57aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1877727158309120:12345-0@lo:400:kworker.0 Request processed in 29us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740545.336798:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790740545.336810:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790740545.336816:0:14357:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db57a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877727158308992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740545.336843:0:14357:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db57a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877727158308992:12345-0@lo:400:kworker.0 Request processed in 26us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740545.336848:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1790740545.336866:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790740545.336901:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d9018f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877727158308864:0@lo:400:kworker.0 00000100:00100000:3.0:1790740545.336912:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d9018d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158308736:0@lo:400:kworker.0 00000100:00100000:3.0:1790740545.336941:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d9018e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1877727158308992:0@lo:400:kworker.0 00000100:00100000:3.0:1790740545.336949:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d9018f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:752c79c8-24e4-410a-832f-aac51b94c085:3304:1877727158308608:0@lo:400:kworker.0 00000100:00100000:3.0:1790740545.336957:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d9018c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1877727158309120:0@lo:400:kworker.0 00000001:00100000:2.0:1790740545.378370:0:5865:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1afbbc59-4fef-403d-8587-7e85da474903 00000001:00100000:2.0:1790740545.378403:0:5865:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 94f64522-bacd-439b-9eb0-785368ef5e14 00000001:00100000:3.0:1790740545.416983:0:7642:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1afbbc59-4fef-403d-8587-7e85da474903 00010000:00010000:1.0:1790740545.840866:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790740546.826455:0:16321:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1790740546.868414:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1790740546.934930:0:6725:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1afbbc59-4fef-403d-8587-7e85da474903 00010000:00010000:2.0:1790740547.889678:0:15644:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740547.890521:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1b41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158309248:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790740547.890650:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740547.893473:0:15045:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158309248 00000100:00100000:0.0:1790740547.893496:0:15045:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158309248 00000100:00100000:0.0:1790740547.893620:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790740547.893633:0:15045:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db57ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158309248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790740547.893712:0:15045:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790740547.894056:0:15045:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db57ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158309248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 426us (3405us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740547.894065:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790740547.894145:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1b41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158309248:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1790740547.894335:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790740548.495146:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740548.495186:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740548.495202:0:14350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133152768 00000100:00100000:0.0:1790740548.495215:0:14350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133152768 00000100:00100000:3.0:1790740548.495235:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740548.495259:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740548.495276:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740548.495288:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 104 00000100:00100000:3.0:1790740548.495292:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740548.495299:0:14350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8742e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dfd6896-73f9-47af-8d09-fc89b7bb7456+13:2369:x1877727133152768:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:3.0:1790740548.495314:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740548.495336:0:14357:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133153280 00000100:00100000:3.0:1790740548.495340:0:14357:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133153280 00000100:00100000:3.0:1790740548.495382:0:14357:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133152896 00000100:00100000:3.0:1790740548.495385:0:14357:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133152896 00000100:00100000:0.0:1790740548.495390:0:14350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8742e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dfd6896-73f9-47af-8d09-fc89b7bb7456+13:2369:x1877727133152768:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 93us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740548.495399:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 104 00000100:00100000:3.0:1790740548.495401:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 20 00000100:00100000:3.0:1790740548.495407:0:14357:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db57a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1afbbc59-4fef-403d-8587-7e85da474903+6:2369:x1877727133153280:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:3.0:1790740548.495453:0:14357:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db57a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1afbbc59-4fef-403d-8587-7e85da474903+6:2369:x1877727133153280:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 46us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740548.495461:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 20 00000100:00100000:3.0:1790740548.495480:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 21 00000100:00100000:3.0:1790740548.495486:0:14357:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d9018f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:94f64522-bacd-439b-9eb0-785368ef5e14+6:2369:x1877727133152896:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:3.0:1790740548.495512:0:14357:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d9018f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:94f64522-bacd-439b-9eb0-785368ef5e14+6:2369:x1877727133152896:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 25us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740548.495512:0:15041:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133153024 00000100:00100000:2.0:1790740548.495516:0:15041:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133153024 00000100:00100000:3.0:1790740548.495518:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 21 00000100:00100000:3.0:1790740548.495536:0:15043:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133153536 00000100:00100000:3.0:1790740548.495539:0:15043:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133153536 00000100:00100000:2.0:1790740548.495540:0:15041:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133153152 00000100:00100000:2.0:1790740548.495542:0:15041:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133153152 00000100:00100000:3.0:1790740548.495553:0:15043:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133153408 00000100:00100000:3.0:1790740548.495555:0:15043:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133153408 00000100:00100000:2.0:1790740548.495563:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 7 00000100:00100000:2.0:1790740548.495569:0:15041:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db57a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:94f64522-bacd-439b-9eb0-785368ef5e14+5:2369:x1877727133153024:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:3.0:1790740548.495589:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 8 00000100:00100000:3.0:1790740548.495595:0:15043:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d9018c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1afbbc59-4fef-403d-8587-7e85da474903+5:2369:x1877727133153536:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:3.0:1790740548.495615:0:15043:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d9018c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1afbbc59-4fef-403d-8587-7e85da474903+5:2369:x1877727133153536:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 21us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740548.495615:0:15041:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db57a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:94f64522-bacd-439b-9eb0-785368ef5e14+5:2369:x1877727133153024:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 46us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740548.495621:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 8 00000100:00100000:2.0:1790740548.500158:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 7 00000100:00100000:2.0:1790740548.500241:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 9 00000100:00100000:2.0:1790740548.500265:0:15041:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d9018e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:94f64522-bacd-439b-9eb0-785368ef5e14+5:2369:x1877727133153152:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:2.0:1790740548.500377:0:15041:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d9018e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:94f64522-bacd-439b-9eb0-785368ef5e14+5:2369:x1877727133153152:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 125us (5081us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740548.500386:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 9 00000100:00100000:2.0:1790740548.500400:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 10 00000100:00100000:2.0:1790740548.500409:0:15041:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d9018d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1afbbc59-4fef-403d-8587-7e85da474903+5:2369:x1877727133153408:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:2.0:1790740548.500467:0:15041:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d9018d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1afbbc59-4fef-403d-8587-7e85da474903+5:2369:x1877727133153408:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 53us (5145us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740548.500474:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 10 00000100:00080000:3.0:1790740548.500805:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790740548.500812:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790740548.500816:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790740548.912990:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790740549.936832:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740550.450040:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0d9018f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158309376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790740550.450118:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740550.450206:0:15045:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158309376 00000100:00100000:3.0:1790740550.450224:0:15045:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158309376 00000100:00100000:3.0:1790740550.450275:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790740550.450295:0:15045:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db6dc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877727158309376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790740550.450328:0:15045:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790740550.450385:0:15045:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db6dc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877727158309376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740550.450392:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1790740550.450415:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790740550.450449:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0d9018f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158309376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790740550.457518:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1b41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:752c79c8-24e4-410a-832f-aac51b94c085:3303:1877727158309504:0@lo:400:kworker.0 00000100:00100000:0.0:1790740550.457602:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740550.457676:0:14351:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158309504 00000100:00100000:0.0:1790740550.457691:0:14351:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158309504 00000100:00100000:0.0:1790740550.457732:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1790740550.457740:0:14351:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8742d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:752c79c8-24e4-410a-832f-aac51b94c085+19:3303:x1877727158309504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740550.457789:0:14351:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8742d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:752c79c8-24e4-410a-832f-aac51b94c085+19:3303:x1877727158309504:12345-0@lo:400:kworker.0 Request processed in 50us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740550.457797:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1790740550.457840:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1b41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:752c79c8-24e4-410a-832f-aac51b94c085:3303:1877727158309504:0@lo:400:kworker.0 00000100:00100000:0.0:1790740550.457877:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1b41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158309632:0@lo:400:kworker.0 00000100:00100000:0.0:1790740550.457903:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740550.457950:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1b43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877727158309760:0@lo:400:kworker.0 00000100:00100000:0.0:1790740550.457974:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740550.458000:0:14357:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158309760 00000100:00100000:0.0:1790740550.458004:0:14357:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158309760 00000100:00100000:0.0:1790740550.458028:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790740550.458035:0:14357:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1b43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877727158309760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740550.458068:0:14357:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1b43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877727158309760:12345-0@lo:400:kworker.0 Request processed in 34us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740550.458074:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790740550.458099:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1b43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877727158309760:0@lo:400:kworker.0 00000100:00100000:0.0:1790740550.458128:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1b43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1877727158309888:0@lo:400:kworker.0 00000100:00100000:0.0:1790740550.458150:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740550.458185:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1b41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1877727158310016:0@lo:400:kworker.0 00000100:00100000:0.0:1790740550.458234:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740550.458263:0:14357:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158309888 00000100:00100000:0.0:1790740550.458266:0:14357:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158309888 00000100:00100000:0.0:1790740550.458297:0:14357:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158310016 00000100:00100000:0.0:1790740550.458301:0:14357:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158310016 00000100:00100000:0.0:1790740550.458316:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790740550.458321:0:14357:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1b40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877727158309888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740550.458354:0:14357:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1b40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877727158309888:12345-0@lo:400:kworker.0 Request processed in 33us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740550.458360:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790740550.458372:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790740550.458378:0:14357:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd86e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877727158310016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740550.458405:0:14357:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd86e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877727158310016:12345-0@lo:400:kworker.0 Request processed in 27us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740550.458412:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790740550.458435:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1b41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1877727158310016:0@lo:400:kworker.0 00000100:00080000:0.0:1790740550.458449:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790740550.458462:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1b43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1877727158309888:0@lo:400:kworker.0 00000100:00100000:2.0:1790740550.460738:0:15041:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158309632 00000100:00100000:2.0:1790740550.460751:0:15041:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158309632 00000100:00100000:2.0:1790740550.460817:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790740550.460827:0:15041:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1b42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158309632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740550.460905:0:15041:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1b42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158309632:12345-0@lo:400:kworker.0 Request processed in 81us (3000us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740550.460913:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790740550.461611:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1b41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158309632:0@lo:400:kworker.0 00000100:00080000:3.0:1790740550.463172:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:1.0:1790740550.950691:0:16470:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc358f1be0 20000000:00000080:1.0:1790740550.950706:0:16470:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f0c8619a800 uarg=0000000000000000 20000000:01000000:1.0:1790740550.950741:0:16470:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1790740550.950746:0:16470:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1790740550.950750:0:16470:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1790740550.953866:0:16471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1790740550.954014:0:16470:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 00010000:00010000:2.0:1790740550.960699:0:15644:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790740550.961412:0:16470:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1790740550.961439:0:16470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f0dc132e200/0xc6b31a1b598eb029 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740550.961458:0:16470:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0d9f977400/0xc6b31a1b598ead20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598ead19 expref: 18 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740550.961466:0:16470:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0d9f976a00/0xc6b31a1b598ead6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598ead66 expref: 18 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740550.961486:0:16470:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0d87595600/0xc6b31a1b598eaea8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598eaea1 expref: 18 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740550.961495:0:16470:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0d9f977600/0xc6b31a1b598eafc7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee813 expref: 12 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740550.961501:0:16470:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0dc132f600/0xc6b31a1b598eafff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee875 expref: 12 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740550.961507:0:16470:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f0dc132e200/0xc6b31a1b598eb029 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740550.961552:0:16470:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0dc132f600/0xc6b31a1b598eafff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee875 expref: 12 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740550.961566:0:16470:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f0dc132f600/0xc6b31a1b598eafff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee875 expref: 12 pid: 14349 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740550.961620:0:16470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd86c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16470:1877727158310144:192.168.203.58@tcp:104: 00010000:00010000:0.0:1790740550.961910:0:16470:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0d9f977600/0xc6b31a1b598eafc7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee813 expref: 12 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740550.961919:0:16470:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f0d9f977600/0xc6b31a1b598eafc7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee813 expref: 12 pid: 14349 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740550.961928:0:16470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd86ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16470:1877727158310272:192.168.203.58@tcp:104: 00010000:00010000:0.0:1790740550.961960:0:16470:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0d87595600/0xc6b31a1b598eaea8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b31a1b598eaea1 expref: 18 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740550.961979:0:16470:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f0d87595600/0xc6b31a1b598eaea8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b31a1b598eaea1 expref: 18 pid: 14350 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740550.961988:0:16470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd86d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16470:1877727158310400:0@lo:104: 00000100:00100000:0.0:1790740550.963228:0:16470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790740550.963302:0:16470:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0d9f976a00/0xc6b31a1b598ead6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b31a1b598ead66 expref: 18 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740550.963316:0:16470:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f0d9f976a00/0xc6b31a1b598ead6d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b31a1b598ead66 expref: 18 pid: 14350 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740550.963328:0:16470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd86d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16470:1877727158310528:0@lo:104: 00000100:00100000:0.0:1790740550.963358:0:16470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740550.963389:0:14339:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158310400 00000100:00100000:0.0:1790740550.963395:0:14339:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158310400 00000100:00100000:0.0:1790740550.963430:0:14339:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158310528 00000100:00100000:0.0:1790740550.963433:0:14339:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158310528 00000100:00100000:0.0:1790740550.963447:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790740550.963454:0:14339:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd86ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:752c79c8-24e4-410a-832f-aac51b94c085+4:16470:x1877727158310400:12345-0@lo:104: 00010000:00010000:0.0:1790740550.963466:0:14339:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0fc00/0xc6b31a1b598eaea1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598eaea8 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740550.963511:0:14339:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790740550.963517:0:14339:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd86ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:752c79c8-24e4-410a-832f-aac51b94c085+4:16470:x1877727158310400:12345-0@lo:104: Request processed in 64us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740550.963523:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790740550.963541:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790740550.963546:0:14339:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd86c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:752c79c8-24e4-410a-832f-aac51b94c085+3:16470:x1877727158310528:12345-0@lo:104: 00010000:00010000:0.0:1790740550.963565:0:14339:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.158@tcp lock: ffff8f0dc132fe00/0xc6b31a1b598ead66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598ead6d expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740550.963774:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790740550.963782:0:14344:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0fc00/0xc6b31a1b598eaea1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598eaea8 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740550.963789:0:14344:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0fc00 already unused, calling callback (ffffffffc1baec20) 10000000:00010000:1.0:1790740550.963793:0:14344:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0fc00/0xc6b31a1b598eaea1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b31a1b598eaea8 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740550.963802:0:14344:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0fc00/0xc6b31a1b598eaea1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b31a1b598eaea8 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790740550.963810:0:14344:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0fc00/0xc6b31a1b598eaea1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b31a1b598eaea8 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790740550.963816:0:14344:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790740550.963844:0:14344:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0fc00/0xc6b31a1b598eaea1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598eaea8 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740550.963850:0:14344:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790740550.963870:0:14344:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0fc00/0xc6b31a1b598eaea1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598eaea8 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740550.963876:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0fc00/0xc6b31a1b598eaea1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598eaea8 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740550.963899:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740550.963901:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740550.963903:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740550.963922:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:752c79c8-24e4-410a-832f-aac51b94c085:3304:1877727158310656:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790740550.963950:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740550.964098:0:14343:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158310656 00000100:00100000:3.0:1790740550.964104:0:14343:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158310656 00010000:00010000:3.0:1790740550.964124:0:14343:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0d87595600/0xc6b31a1b598eaea8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598eaea1 expref: 19 pid: 14350 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740550.964143:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790740550.964148:0:14343:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:752c79c8-24e4-410a-832f-aac51b94c085+19:3304:x1877727158310656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790740550.964158:0:14343:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740550.964162:0:14343:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0d87595600/0xc6b31a1b598eaea8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598eaea1 expref: 19 pid: 14350 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740550.964170:0:14343:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0d87595600/0xc6b31a1b598eaea8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b31a1b598eaea1 expref: 19 pid: 14350 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740550.964186:0:14343:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790740550.964226:0:14343:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:752c79c8-24e4-410a-832f-aac51b94c085+19:3304:x1877727158310656:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740550.964233:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790740550.964272:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:752c79c8-24e4-410a-832f-aac51b94c085:3304:1877727158310656:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790740550.964424:0:14339:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790740550.964430:0:14339:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd86c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:752c79c8-24e4-410a-832f-aac51b94c085+3:16470:x1877727158310528:12345-0@lo:104: Request processed in 883us (1070us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740550.964436:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1790740550.964469:0:16470:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0d9f977400/0xc6b31a1b598ead20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b31a1b598ead19 expref: 18 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740550.964478:0:16470:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f0d9f977400/0xc6b31a1b598ead20 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b31a1b598ead19 expref: 18 pid: 14349 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740550.964486:0:16470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd86f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16470:1877727158310784:0@lo:104: 00000100:00100000:0.0:1790740550.964514:0:16470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740550.964529:0:16470:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0db563bb40 going to sleep for 11 seconds 00010000:00010000:0.0:1790740550.964541:0:16470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0d87595600/0xc6b31a1b598eaea8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b31a1b598eaea1 expref: 18 pid: 14350 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740550.964551:0:16470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd86d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16470:1877727158310400:0@lo:104: 00000100:00100000:0.0:1790740550.964558:0:16470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd86d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16470:1877727158310528:0@lo:104: 00010000:00010000:1.0:1790740550.964632:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790740550.964637:0:14345:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.158@tcp lock: ffff8f0dc132fe00/0xc6b31a1b598ead66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598ead6d expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740550.964644:0:14345:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132fe00 already unused, calling callback (ffffffffc1baec20) 10000000:00010000:1.0:1790740550.964647:0:14345:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.158@tcp lock: ffff8f0dc132fe00/0xc6b31a1b598ead66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b31a1b598ead6d expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740550.964655:0:14345:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.158@tcp lock: ffff8f0dc132fe00/0xc6b31a1b598ead66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b31a1b598ead6d expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790740550.964662:0:14345:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.158@tcp lock: ffff8f0dc132fe00/0xc6b31a1b598ead66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b31a1b598ead6d expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790740550.964667:0:14345:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790740550.964689:0:14345:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.158@tcp lock: ffff8f0dc132fe00/0xc6b31a1b598ead66 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598ead6d expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740550.964696:0:14345:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790740550.964713:0:14345:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.158@tcp lock: ffff8f0dc132fe00/0xc6b31a1b598ead66 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598ead6d expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740550.964729:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.158@tcp lock: ffff8f0dc132fe00/0xc6b31a1b598ead66 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598ead6d expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740550.964753:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740550.964755:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740550.964757:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740550.964767:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:752c79c8-24e4-410a-832f-aac51b94c085:3305:1877727158310912:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790740550.964791:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740550.965471:0:14342:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158310912 00000100:00100000:3.0:1790740550.965487:0:14342:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158310912 00010000:00010000:3.0:1790740550.965508:0:14342:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0d9f976a00/0xc6b31a1b598ead6d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598ead66 expref: 18 pid: 14350 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740550.967989:0:14340:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1790740550.968022:0:14340:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158310784 00000100:00100000:1.0:1790740550.968031:0:14340:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158310784 00000100:00100000:1.0:1790740550.968098:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790740550.968108:0:14340:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee4d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:752c79c8-24e4-410a-832f-aac51b94c085+3:16470:x1877727158310784:12345-0@lo:104: 00010000:00010000:1.0:1790740550.968126:0:14340:0:(ldlm_lockd.c:2509:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0f400/0xc6b31a1b598ead19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598ead20 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740550.968202:0:14340:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790740550.968218:0:14340:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee4d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:752c79c8-24e4-410a-832f-aac51b94c085+3:16470:x1877727158310784:12345-0@lo:104: Request processed in 113us (3704us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740550.968225:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1790740550.969013:0:15644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790740550.969022:0:15644:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0f400/0xc6b31a1b598ead19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b31a1b598ead20 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740550.969030:0:15644:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0f400 already unused, calling callback (ffffffffc1baec20) 10000000:00010000:2.0:1790740550.969035:0:15644:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0f400/0xc6b31a1b598ead19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b31a1b598ead20 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740550.969044:0:15644:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0f400/0xc6b31a1b598ead19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b31a1b598ead20 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790740550.969052:0:15644:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0f400/0xc6b31a1b598ead19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b31a1b598ead20 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790740550.969059:0:15644:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790740550.969109:0:15644:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0f400/0xc6b31a1b598ead19 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598ead20 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740550.969133:0:15644:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790740550.969158:0:15644:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0f400/0xc6b31a1b598ead19 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598ead20 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740550.969165:0:15644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.158@tcp lock: ffff8f0db6c0f400/0xc6b31a1b598ead19 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b31a1b598ead20 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740550.969183:0:15644:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740550.969185:0:15644:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790740550.969187:0:15644:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790740550.969201:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd7d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:752c79c8-24e4-410a-832f-aac51b94c085:3306:1877727158311040:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790740550.969257:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740550.978204:0:14342:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158311040 00000100:00100000:3.0:1790740550.978228:0:14342:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158311040 00010000:00010000:3.0:1790740550.978271:0:14342:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0d9f977400/0xc6b31a1b598ead20 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598ead19 expref: 19 pid: 14349 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740550.978300:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790740550.978308:0:14342:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:752c79c8-24e4-410a-832f-aac51b94c085+19:3305:x1877727158310912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790740550.978322:0:14342:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740550.978328:0:14342:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0d9f976a00/0xc6b31a1b598ead6d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598ead66 expref: 19 pid: 14350 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740550.978338:0:14342:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0d9f976a00/0xc6b31a1b598ead6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b31a1b598ead66 expref: 19 pid: 14350 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740550.978354:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0d9f976a00/0xc6b31a1b598ead6d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b31a1b598ead66 expref: 19 pid: 14350 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740550.978367:0:14342:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790740550.978437:0:14342:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:752c79c8-24e4-410a-832f-aac51b94c085+18:3305:x1877727158310912:12345-0@lo:103:ldlm_bl.0 Request processed in 129us (13644us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740550.978445:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790740550.978464:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790740550.978470:0:14342:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd8f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:752c79c8-24e4-410a-832f-aac51b94c085+17:3306:x1877727158311040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790740550.978477:0:14342:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740550.978482:0:14342:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0d9f977400/0xc6b31a1b598ead20 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b31a1b598ead19 expref: 17 pid: 14349 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740550.978506:0:14342:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0d9f977400/0xc6b31a1b598ead20 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b31a1b598ead19 expref: 17 pid: 14349 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740550.978516:0:14342:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790740550.978523:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:752c79c8-24e4-410a-832f-aac51b94c085:3305:1877727158310912:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790740550.978543:0:14342:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd8f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:752c79c8-24e4-410a-832f-aac51b94c085+17:3306:x1877727158311040:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (9286us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740550.978549:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790740550.978625:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd7d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:752c79c8-24e4-410a-832f-aac51b94c085:3306:1877727158311040:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790740550.979103:0:16470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd86c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16470:1877727158310144:192.168.203.58@tcp:104: 00000100:00100000:0.0:1790740550.979114:0:16470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd86ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16470:1877727158310272:192.168.203.58@tcp:104: 00010000:00010000:0.0:1790740550.979124:0:16470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0d9f977400/0xc6b31a1b598ead20 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b31a1b598ead19 expref: 16 pid: 14349 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740550.979134:0:16470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd86f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16470:1877727158310784:0@lo:104: 00010000:00010000:0.0:1790740550.979159:0:16470:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f0dc132e200/0xc6b31a1b598eb029 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740550.981953:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740550.982103:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740550.997395:0:14342:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133153664 00000100:00100000:3.0:1790740550.997415:0:14342:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133153664 00010000:00010000:3.0:1790740550.997476:0:14342:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0dc132f600/0xc6b31a1b598eafff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee875 expref: 13 pid: 14349 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740550.997509:0:14342:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133153792 00000100:00100000:3.0:1790740550.997512:0:14342:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133153792 00010000:00010000:3.0:1790740550.997523:0:14342:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0d9f977600/0xc6b31a1b598eafc7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee813 expref: 14 pid: 14349 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740550.997537:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 7 00000100:00100000:3.0:1790740550.997546:0:14342:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd7d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9dfd6896-73f9-47af-8d09-fc89b7bb7456+14:2370:x1877727133153664:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790740550.997560:0:14342:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740550.997566:0:14342:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0dc132f600/0xc6b31a1b598eafff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee875 expref: 14 pid: 14349 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740550.998454:0:14342:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0dc132f600/0xc6b31a1b598eafff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee875 expref: 14 pid: 14349 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740550.998475:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0dc132f600/0xc6b31a1b598eafff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee875 expref: 14 pid: 14349 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740550.998512:0:14342:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790740550.999289:0:14342:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd7d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9dfd6896-73f9-47af-8d09-fc89b7bb7456+13:2370:x1877727133153664:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 1738us (17339us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740550.999300:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 7 00000100:00100000:3.0:1790740550.999336:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 8 00000100:00100000:3.0:1790740550.999346:0:14342:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd7d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9dfd6896-73f9-47af-8d09-fc89b7bb7456+12:2370:x1877727133153792:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790740550.999360:0:14342:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740550.999377:0:14342:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0d9f977600/0xc6b31a1b598eafc7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee813 expref: 12 pid: 14349 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740550.999389:0:14342:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0d9f977600/0xc6b31a1b598eafc7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee813 expref: 12 pid: 14349 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740550.999402:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0d9f977600/0xc6b31a1b598eafc7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee813 expref: 12 pid: 14349 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740550.999417:0:14342:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f0dc132e200/0xc6b31a1b598eb029 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740550.999426:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0dc132e200/0xc6b31a1b598eb029 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740550.999443:0:14342:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f0dc132e200/0xc6b31a1b598eb029 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740550.999450:0:14342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f0dc132e200/0xc6b31a1b598eb029 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740550.999470:0:14342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f0dc132e200/0xc6b31a1b598eb029 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740550.999478:0:14342:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f0dc132e200/0xc6b31a1b598eb029 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740550.999484:0:14342:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132e200 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:3.0:1790740550.999488:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f0dc132e200/0xc6b31a1b598eb029 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740550.999497:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f0dc132e200/0xc6b31a1b598eb029 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740550.999515:0:14342:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f0dc132e200/0xc6b31a1b598eb029 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740550.999526:0:14342:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790740551.000854:0:14342:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd7d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9dfd6896-73f9-47af-8d09-fc89b7bb7456+11:2370:x1877727133153792:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 1502us (18742us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740551.000864:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 8 00010000:00010000:0.0:1790740551.001348:0:16470:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f0dc132e200/0xc6b31a1b598eb029 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740551.001360:0:16470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f0dc132e200/0xc6b31a1b598eb029 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740551.001367:0:16470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0dc132e200/0xc6b31a1b598eb029 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740551.986445:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1790740552.241707:0:14353:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790740552.241715:0:14353:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f0c84e4f800 from 10 10000000:01000000:1.0:1790740552.241721:0:14353:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790740552.241945:0:14353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977e00/0xc6b31a1b598eb030 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740552.241958:0:14353:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977e00/0xc6b31a1b598eb030 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740552.241971:0:14353:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977e00/0xc6b31a1b598eb030 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740552.242008:0:14353:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda73100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:752c79c8-24e4-410a-832f-aac51b94c085:14353:1877727158311168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790740552.242073:0:14353:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740552.242135:0:14353:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d98019a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790740552.242228:0:14349:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158311168 00000100:00100000:0.0:1790740552.242237:0:14349:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158311168 00000100:00100000:0.0:1790740552.242289:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1790740552.242298:0:14349:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8742f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:752c79c8-24e4-410a-832f-aac51b94c085+16:14353:x1877727158311168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790740552.242309:0:14349:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740552.242324:0:14349:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0dc132e200/0xc6b31a1b598eb037 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b31a1b598eb030 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740552.242347:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0dc132e200/0xc6b31a1b598eb037 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b31a1b598eb030 expref: 17 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740552.242358:0:14349:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0dc132e200/0xc6b31a1b598eb037 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598eb030 expref: 17 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740552.242367:0:14349:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0dc132e200, rc 0) 00000100:00100000:0.0:1790740552.242405:0:14349:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8742f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:752c79c8-24e4-410a-832f-aac51b94c085+17:14353:x1877727158311168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740552.242412:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1790740552.242454:0:14353:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda73100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:752c79c8-24e4-410a-832f-aac51b94c085:14353:1877727158311168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790740552.242475:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977e00/0xc6b31a1b598eb030 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598eb037 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740552.242484:0:14353:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977e00/0xc6b31a1b598eb030 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598eb037 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740552.242539:0:14353:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd86f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:752c79c8-24e4-410a-832f-aac51b94c085:14353:1877727158311296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790740552.242564:0:14353:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740552.242598:0:14353:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0db563b480 going to sleep for 11 seconds 00000100:00100000:0.0:1790740552.242611:0:14350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158311296 00000100:00100000:0.0:1790740552.242614:0:14350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158311296 00000100:00100000:0.0:1790740552.242966:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1790740552.242974:0:14350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8742ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+17:14353:x1877727158311296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790740552.243213:0:14350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8742ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+17:14353:x1877727158311296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 239us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740552.243221:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1790740552.243252:0:14353:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd86f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:752c79c8-24e4-410a-832f-aac51b94c085:14353:1877727158311296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790740552.243281:0:14353:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd86f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:752c79c8-24e4-410a-832f-aac51b94c085:14353:1877727158311424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790740552.243317:0:14353:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740552.243330:0:14353:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0db563b480 going to sleep for 11 seconds 00000100:00100000:0.0:1790740552.243342:0:14350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158311424 00000100:00100000:0.0:1790740552.243345:0:14350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158311424 00000100:00100000:0.0:1790740552.243361:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1790740552.243366:0:14350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8742fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+17:14353:x1877727158311424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790740552.243499:0:14350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8742fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+17:14353:x1877727158311424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 132us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740552.243516:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1790740552.243550:0:14353:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd86f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:752c79c8-24e4-410a-832f-aac51b94c085:14353:1877727158311424:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790740552.249968:0:16514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1790740552.250799:0:14353:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1790740552.250824:0:14353:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790740552.250835:0:14353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977e00/0xc6b31a1b598eb030 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598eb037 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740552.250848:0:14353:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.158@tcp lock: ffff8f0d9f977e00/0xc6b31a1b598eb030 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598eb037 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740552.250858:0:14353:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790740552.250861:0:14353:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f0dbdaf3000 from 10 10000000:01000000:0.0:1790740552.250865:0:14353:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790740552.250904:0:14353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0dc132f600/0xc6b31a1b598eb03e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740552.250912:0:14353:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.158@tcp lock: ffff8f0dc132f600/0xc6b31a1b598eb03e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740552.250923:0:14353:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.158@tcp lock: ffff8f0dc132f600/0xc6b31a1b598eb03e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740552.250948:0:14353:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd86f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:752c79c8-24e4-410a-832f-aac51b94c085:14353:1877727158311552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790740552.251008:0:14353:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740552.251072:0:14353:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0db563b480 going to sleep for 11 seconds 00000100:00100000:2.0:1790740552.251084:0:14350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158311552 00000100:00100000:2.0:1790740552.251093:0:14350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158311552 00000100:00100000:2.0:1790740552.251155:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1790740552.251164:0:14350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8742f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+17:14353:x1877727158311552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790740552.251179:0:14350:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740552.251192:0:14350:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0c84d0c400/0xc6b31a1b598eb045 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b31a1b598eb03e expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740552.251227:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0c84d0c400/0xc6b31a1b598eb045 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b31a1b598eb03e expref: 18 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740552.251262:0:14350:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0c84d0c400/0xc6b31a1b598eb045 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598eb03e expref: 18 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740552.251271:0:14350:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0c84d0c400, rc 0) 00000100:00100000:2.0:1790740552.251325:0:14350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8742f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+18:14353:x1877727158311552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740552.251332:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1790740552.251736:0:14353:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd86f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:752c79c8-24e4-410a-832f-aac51b94c085:14353:1877727158311552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790740552.251751:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.158@tcp lock: ffff8f0dc132f600/0xc6b31a1b598eb03e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598eb045 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740552.251760:0:14353:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.158@tcp lock: ffff8f0dc132f600/0xc6b31a1b598eb03e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598eb045 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740552.251824:0:14353:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db6dc1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:752c79c8-24e4-410a-832f-aac51b94c085:14353:1877727158311680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790740552.251860:0:14353:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740552.251876:0:14353:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d875846c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790740552.251891:0:14349:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158311680 00000100:00100000:3.0:1790740552.251895:0:14349:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158311680 00000100:00100000:3.0:1790740552.251919:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1790740552.251926:0:14349:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8742e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:752c79c8-24e4-410a-832f-aac51b94c085+18:14353:x1877727158311680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790740552.252166:0:14349:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8742e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:752c79c8-24e4-410a-832f-aac51b94c085+18:14353:x1877727158311680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 239us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740552.252173:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1790740552.252218:0:14353:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db6dc1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:752c79c8-24e4-410a-832f-aac51b94c085:14353:1877727158311680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790740552.252247:0:14353:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db6dc1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:752c79c8-24e4-410a-832f-aac51b94c085:14353:1877727158311808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790740552.252282:0:14353:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740552.252296:0:14353:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d875846c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790740552.252308:0:14351:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158311808 00000100:00100000:3.0:1790740552.252311:0:14351:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158311808 00000100:00100000:3.0:1790740552.252331:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1790740552.252338:0:14351:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8742d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:752c79c8-24e4-410a-832f-aac51b94c085+18:14353:x1877727158311808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790740552.252481:0:14351:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8742d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:752c79c8-24e4-410a-832f-aac51b94c085+18:14353:x1877727158311808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 143us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740552.252488:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1790740552.252527:0:14353:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db6dc1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:752c79c8-24e4-410a-832f-aac51b94c085:14353:1877727158311808:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790740552.253916:0:16516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1790740552.254171:0:14353:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1790740552.254191:0:14353:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790740552.254209:0:14353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0dc132f600/0xc6b31a1b598eb03e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598eb045 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740552.254225:0:14353:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.158@tcp lock: ffff8f0dc132f600/0xc6b31a1b598eb03e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598eb045 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790740552.254243:0:14353:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790740552.254246:0:14353:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f0c86750000 from 10 10000000:01000000:0.0:1790740552.254248:0:14353:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790740552.254278:0:14353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0dc132fe00/0xc6b31a1b598eb04c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740552.254286:0:14353:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.158@tcp lock: ffff8f0dc132fe00/0xc6b31a1b598eb04c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740552.254296:0:14353:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.158@tcp lock: ffff8f0dc132fe00/0xc6b31a1b598eb04c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740552.254319:0:14353:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd86ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:752c79c8-24e4-410a-832f-aac51b94c085:14353:1877727158311936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790740552.254371:0:14353:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740552.254427:0:14353:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0db563b240 going to sleep for 11 seconds 00000100:00100000:3.0:1790740552.256943:0:14350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158311936 00000100:00100000:3.0:1790740552.256956:0:14350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158311936 00000100:00100000:3.0:1790740552.257012:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1790740552.257030:0:14350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8742e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+18:14353:x1877727158311936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790740552.257045:0:14350:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740552.257061:0:14350:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0db6c0ea00/0xc6b31a1b598eb053 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b31a1b598eb04c expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740552.257089:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0db6c0ea00/0xc6b31a1b598eb053 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b31a1b598eb04c expref: 19 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740552.257100:0:14350:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0db6c0ea00/0xc6b31a1b598eb053 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b31a1b598eb04c expref: 19 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740552.257108:0:14350:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0db6c0ea00, rc 0) 00000100:00100000:3.0:1790740552.257185:0:14350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8742e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:752c79c8-24e4-410a-832f-aac51b94c085+19:14353:x1877727158311936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (2813us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740552.257192:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1790740552.258949:0:14353:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd86ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:752c79c8-24e4-410a-832f-aac51b94c085:14353:1877727158311936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790740552.258974:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.158@tcp lock: ffff8f0dc132fe00/0xc6b31a1b598eb04c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598eb053 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740552.258987:0:14353:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.158@tcp lock: ffff8f0dc132fe00/0xc6b31a1b598eb04c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b31a1b598eb053 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740552.259064:0:14353:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd7d5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:752c79c8-24e4-410a-832f-aac51b94c085:14353:1877727158312064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790740552.259121:0:14353:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740552.259166:0:14353:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0dbda3d000 going to sleep for 11 seconds 00000100:00100000:3.0:1790740552.259239:0:14349:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158312064 00000100:00100000:3.0:1790740552.259245:0:14349:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158312064 00000100:00100000:3.0:1790740552.259286:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1790740552.259294:0:14349:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc132a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:752c79c8-24e4-410a-832f-aac51b94c085+19:14353:x1877727158312064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790740552.259531:0:14349:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc132a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:752c79c8-24e4-410a-832f-aac51b94c085+19:14353:x1877727158312064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 237us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740552.259539:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1790740552.259603:0:14353:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd7d5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:752c79c8-24e4-410a-832f-aac51b94c085:14353:1877727158312064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790740552.259708:0:14353:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db6dc1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:752c79c8-24e4-410a-832f-aac51b94c085:14353:1877727158312192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790740552.261898:0:14353:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740552.261960:0:14353:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d98727900 going to sleep for 11 seconds 00000100:00100000:0.0:1790740552.262294:0:14351:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158312192 00000100:00100000:0.0:1790740552.262302:0:14351:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158312192 00000100:00100000:0.0:1790740552.262353:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1790740552.262361:0:14351:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1328050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:752c79c8-24e4-410a-832f-aac51b94c085+19:14353:x1877727158312192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790740552.262551:0:14351:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1328050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:752c79c8-24e4-410a-832f-aac51b94c085+19:14353:x1877727158312192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 191us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740552.262559:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1790740552.262747:0:14353:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db6dc1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:752c79c8-24e4-410a-832f-aac51b94c085:14353:1877727158312192:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790740552.264433:0:16519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1790740552.266895:0:14353:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1790740552.266929:0:14353:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790740552.266940:0:14353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.158@tcp lock: ffff8f0dc132fe00/0xc6b31a1b598eb04c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598eb053 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740552.266953:0:14353:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.158@tcp lock: ffff8f0dc132fe00/0xc6b31a1b598eb04c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b31a1b598eb053 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740552.459260:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740552.459354:0:14350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133153920 00000100:00100000:3.0:1790740552.459363:0:14350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133153920 00000100:00100000:3.0:1790740552.459461:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 115 00000100:00100000:3.0:1790740552.459471:0:14350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1329c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dfd6896-73f9-47af-8d09-fc89b7bb7456+11:13748:x1877727133153920:12345-192.168.203.58@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790740552.459488:0:14350:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740552.459505:0:14350:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0db6c0f800/0xc6b31a1b598eb05a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee8a6 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740552.459532:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0db6c0f800/0xc6b31a1b598eb05a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee8a6 expref: 12 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740552.459545:0:14350:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0db6c0f800/0xc6b31a1b598eb05a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee8a6 expref: 12 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740552.459553:0:14350:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0db6c0f800, rc 0) 00000100:00100000:3.0:1790740552.459637:0:14350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1329c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dfd6896-73f9-47af-8d09-fc89b7bb7456+12:13748:x1877727133153920:12345-192.168.203.58@tcp:101:ll_cfg_requeue.0 Request processed in 167us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740552.459646:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 115 00000100:00100000:2.0:1790740552.463214:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740552.463321:0:14349:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133154048 00000100:00100000:3.0:1790740552.463332:0:14349:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133154048 00000100:00100000:3.0:1790740552.463441:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 116 00000100:00100000:3.0:1790740552.463451:0:14349:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1329050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dfd6896-73f9-47af-8d09-fc89b7bb7456+12:13748:x1877727133154048:12345-192.168.203.58@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790740552.463880:0:14349:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1329050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dfd6896-73f9-47af-8d09-fc89b7bb7456+12:13748:x1877727133154048:12345-192.168.203.58@tcp:501:ll_cfg_requeue.0 Request processed in 429us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740552.463889:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 116 00000100:00100000:2.0:1790740552.471515:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740552.477456:0:14350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133154176 00000100:00100000:3.0:1790740552.477469:0:14350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133154176 00000100:00100000:2.0:1790740552.477626:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 117 00000100:00100000:2.0:1790740552.477645:0:14350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc132b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dfd6896-73f9-47af-8d09-fc89b7bb7456+12:13748:x1877727133154176:12345-192.168.203.58@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790740552.477880:0:14350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc132b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dfd6896-73f9-47af-8d09-fc89b7bb7456+12:13748:x1877727133154176:12345-192.168.203.58@tcp:503:ll_cfg_requeue.0 Request processed in 243us (6372us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740552.477887:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 117 00000100:00100000:3.0:1790740552.492385:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740552.492418:0:14349:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133154304 00000100:00100000:3.0:1790740552.492426:0:14349:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133154304 00000100:00100000:3.0:1790740552.492470:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 118 00000100:00100000:3.0:1790740552.492479:0:14349:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1328450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dfd6896-73f9-47af-8d09-fc89b7bb7456+12:13748:x1877727133154304:12345-192.168.203.58@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790740552.492495:0:14349:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740552.492512:0:14349:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0db6c0e400/0xc6b31a1b598eb061 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee8ad expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740552.492538:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0db6c0e400/0xc6b31a1b598eb061 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee8ad expref: 13 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740552.492550:0:14349:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0db6c0e400/0xc6b31a1b598eb061 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee8ad expref: 13 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740552.492559:0:14349:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0db6c0e400, rc 0) 00000100:00100000:3.0:1790740552.492629:0:14349:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1328450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dfd6896-73f9-47af-8d09-fc89b7bb7456+13:13748:x1877727133154304:12345-192.168.203.58@tcp:101:ll_cfg_requeue.0 Request processed in 150us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740552.492636:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 118 00000100:00100000:3.0:1790740552.504963:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740552.509729:0:14351:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133154432 00000100:00100000:0.0:1790740552.509743:0:14351:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133154432 00000100:00100000:0.0:1790740552.509791:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 119 00000100:00100000:0.0:1790740552.509814:0:14351:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc132b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dfd6896-73f9-47af-8d09-fc89b7bb7456+13:13748:x1877727133154432:12345-192.168.203.58@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790740552.512705:0:14351:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc132b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dfd6896-73f9-47af-8d09-fc89b7bb7456+13:13748:x1877727133154432:12345-192.168.203.58@tcp:501:ll_cfg_requeue.0 Request processed in 2882us (7741us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740552.512718:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 119 00000100:00100000:3.0:1790740552.527780:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740552.527811:0:14350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133154560 00000100:00100000:3.0:1790740552.527821:0:14350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133154560 00000100:00100000:3.0:1790740552.527865:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 120 00000100:00100000:3.0:1790740552.527874:0:14350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc132ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dfd6896-73f9-47af-8d09-fc89b7bb7456+13:13748:x1877727133154560:12345-192.168.203.58@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790740552.528077:0:14350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc132ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dfd6896-73f9-47af-8d09-fc89b7bb7456+13:13748:x1877727133154560:12345-192.168.203.58@tcp:503:ll_cfg_requeue.0 Request processed in 203us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740552.528085:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 120 00000100:00100000:2.0:1790740553.015853:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790740553.015876:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd7d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158312320:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790740553.015941:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740553.016026:0:15045:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158312320 00000100:00100000:2.0:1790740553.016034:0:15045:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158312320 00000100:00100000:2.0:1790740553.016085:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790740553.016094:0:15045:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd7d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158312320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790740553.016129:0:15045:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790740553.016175:0:15045:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd7d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158312320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740553.016182:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1790740553.016214:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790740553.016249:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd7d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158312320:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790740553.017796:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790740553.611149:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740553.611179:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740553.611218:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740553.611281:0:14351:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133154688 00000100:00100000:0.0:1790740553.611292:0:14351:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133154688 00000100:00100000:0.0:1790740553.611353:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 121 00000100:00100000:0.0:1790740553.611363:0:14351:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc132a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dfd6896-73f9-47af-8d09-fc89b7bb7456+13:2370:x1877727133154688:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:0.0:1790740553.611430:0:14351:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc132a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dfd6896-73f9-47af-8d09-fc89b7bb7456+13:2370:x1877727133154688:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 69us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740553.611438:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 121 00000100:00100000:2.0:1790740553.611548:0:16022:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133154944 00000100:00100000:2.0:1790740553.611555:0:16022:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133154944 00000100:00100000:2.0:1790740553.611658:0:16022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 12 00000100:00080000:0.0:1790740553.611663:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790740553.611668:0:16022:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db6dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:94f64522-bacd-439b-9eb0-785368ef5e14+5:2370:x1877727133154944:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:2.0:1790740553.611735:0:16022:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db6dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:94f64522-bacd-439b-9eb0-785368ef5e14+5:2370:x1877727133154944:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 69us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740553.611742:0:16022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 12 00000100:00100000:0.0:1790740553.611939:0:14357:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133155200 00000100:00100000:0.0:1790740553.611944:0:14357:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133155200 00000100:00100000:3.0:1790740553.611966:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740553.611993:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 25 00000100:00100000:0.0:1790740553.612003:0:14357:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db6dc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1afbbc59-4fef-403d-8587-7e85da474903+6:2370:x1877727133155200:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:3.0:1790740553.612008:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740553.612035:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740553.612050:0:14357:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db6dc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1afbbc59-4fef-403d-8587-7e85da474903+6:2370:x1877727133155200:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 47us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740553.612058:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 25 00000100:00100000:0.0:1790740553.612071:0:14357:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133154816 00000100:00100000:0.0:1790740553.612073:0:14357:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133154816 00000100:00100000:0.0:1790740553.612096:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 26 00000100:00100000:0.0:1790740553.612104:0:14357:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db6dc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:94f64522-bacd-439b-9eb0-785368ef5e14+6:2370:x1877727133154816:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:3.0:1790740553.612113:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740553.612168:0:15041:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133155456 00000100:00100000:1.0:1790740553.612173:0:15041:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133155456 00000100:00100000:1.0:1790740553.612223:0:15041:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133155072 00000100:00100000:1.0:1790740553.612226:0:15041:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133155072 00000100:00100000:1.0:1790740553.612241:0:15041:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133155328 00000100:00100000:1.0:1790740553.612243:0:15041:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133155328 00000100:00100000:1.0:1790740553.612257:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 13 00000100:00100000:1.0:1790740553.612263:0:15041:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db6dc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1afbbc59-4fef-403d-8587-7e85da474903+5:2370:x1877727133155456:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:0.0:1790740553.612303:0:14357:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db6dc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:94f64522-bacd-439b-9eb0-785368ef5e14+6:2370:x1877727133154816:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 200us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740553.612319:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 26 00000100:00100000:3.0:1790740553.613307:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 14 00000100:00100000:3.0:1790740553.613328:0:15044:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db6dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:94f64522-bacd-439b-9eb0-785368ef5e14+5:2370:x1877727133155072:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:3.0:1790740553.613367:0:15044:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db6dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:94f64522-bacd-439b-9eb0-785368ef5e14+5:2370:x1877727133155072:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 52us (1332us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740553.613374:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 14 00000100:00100000:3.0:1790740553.613390:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 15 00000100:00100000:3.0:1790740553.613397:0:15044:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db6dc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1afbbc59-4fef-403d-8587-7e85da474903+5:2370:x1877727133155328:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:3.0:1790740553.613421:0:15044:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db6dc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1afbbc59-4fef-403d-8587-7e85da474903+5:2370:x1877727133155328:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 25us (1309us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740553.613427:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 15 00000100:00080000:2.0:1790740553.613507:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790740553.613512:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790740553.613514:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790740553.613802:0:15041:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db6dc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1afbbc59-4fef-403d-8587-7e85da474903+5:2370:x1877727133155456:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 1536us (1834us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740553.613810:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 13 00010000:00010000:2.0:1790740554.033808:0:15644:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790740554.419201:0:14391:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1790740554.879075:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740554.879188:0:14357:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133155584 00000100:00100000:0.0:1790740554.879199:0:14357:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133155584 00000100:00100000:0.0:1790740554.879264:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 15 00000100:00100000:0.0:1790740554.879275:0:14357:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db6dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:94f64522-bacd-439b-9eb0-785368ef5e14+6:14404:x1877727133155584:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790740554.879295:0:14357:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740554.879317:0:14357:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e000/0xc6b31a1b598eb068 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee8b4 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740554.879384:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598eb06f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740554.879399:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598eb06f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740554.879415:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598eb06f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740554.879428:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e800/0xc6b31a1b598eb076 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740554.879435:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e800/0xc6b31a1b598eb076 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740554.879441:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e800/0xc6b31a1b598eb076 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740554.880031:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ea00/0xc6b31a1b598eb07d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740554.880053:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ea00/0xc6b31a1b598eb07d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740554.880062:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ea00/0xc6b31a1b598eb07d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790740554.880088:0:14357:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790740554.880092:0:14357:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790740554.880125:0:14357:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ea00/0xc6b31a1b598eb07d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740554.880137:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598eb06f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740554.880145:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598eb06f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740554.880152:0:14357:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598eb06f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740554.880158:0:14357:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132ee00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1790740554.880163:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598eb06f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740554.880171:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598eb06f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740554.880192:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0d84a1e200) 00010000:00010000:0.0:1790740554.880196:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740554.880201:0:14357:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598eb06f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740554.880217:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598eb06f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740554.880230:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e800/0xc6b31a1b598eb076 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740554.880236:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e800/0xc6b31a1b598eb076 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740554.880241:0:14357:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e800/0xc6b31a1b598eb076 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740554.880245:0:14357:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132e800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1790740554.880248:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e800/0xc6b31a1b598eb076 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740554.880254:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e800/0xc6b31a1b598eb076 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740554.880261:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8f0d84bf8d00) 00010000:00010000:0.0:1790740554.880264:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740554.880267:0:14357:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e800/0xc6b31a1b598eb076 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740554.880272:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e800/0xc6b31a1b598eb076 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740554.880307:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e000/0xc6b31a1b598eb068 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee8b4 expref: 8 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740554.880331:0:14357:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ea00/0xc6b31a1b598eb07d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee8b4 expref: 7 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740554.880339:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8f0d84bf8200) 00010000:00010000:0.0:1790740554.880342:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790740554.880344:0:14357:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0dc132ea00, rc 0) 00000100:00100000:0.0:1790740554.880408:0:14357:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db6dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:94f64522-bacd-439b-9eb0-785368ef5e14+7:14404:x1877727133155584:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 Request processed in 1134us (1341us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740554.880416:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 15 00000100:00100000:0.0:1790740554.896538:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740554.896651:0:14356:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133155840 00000100:00100000:2.0:1790740554.896661:0:14356:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133155840 00000100:00100000:2.0:1790740554.896732:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 16 00000100:00100000:2.0:1790740554.896742:0:14356:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd86c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:94f64522-bacd-439b-9eb0-785368ef5e14+7:14404:x1877727133155840:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790740554.896761:0:14356:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740554.896782:0:14356:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0d200/0xc6b31a1b598eb084 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee8bb expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740554.896864:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0ca00/0xc6b31a1b598eb08b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740554.896880:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0ca00/0xc6b31a1b598eb08b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740554.896890:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0ca00/0xc6b31a1b598eb08b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740554.896904:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0cc00/0xc6b31a1b598eb092 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740554.896910:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0cc00/0xc6b31a1b598eb092 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740554.896935:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0cc00/0xc6b31a1b598eb092 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740554.897275:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0c000/0xc6b31a1b598eb099 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740554.897285:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0c000/0xc6b31a1b598eb099 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740554.897292:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0c000/0xc6b31a1b598eb099 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740554.897301:0:14356:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1790740554.897479:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0ca00/0xc6b31a1b598eb08b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740554.897488:0:14356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0ca00/0xc6b31a1b598eb08b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740554.897495:0:14356:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0ca00/0xc6b31a1b598eb08b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740554.897502:0:14356:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0c84d0ca00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740554.897506:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0ca00/0xc6b31a1b598eb08b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740554.897515:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0ca00/0xc6b31a1b598eb08b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740554.897525:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8f0d84bf8200) 00010000:00010000:2.0:1790740554.897528:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740554.897538:0:14356:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0ca00/0xc6b31a1b598eb08b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740554.897545:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0ca00/0xc6b31a1b598eb08b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740554.897557:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0cc00/0xc6b31a1b598eb092 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740554.897564:0:14356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0cc00/0xc6b31a1b598eb092 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740554.897616:0:14356:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0cc00/0xc6b31a1b598eb092 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740554.897622:0:14356:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0c84d0cc00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740554.897626:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0cc00/0xc6b31a1b598eb092 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740554.897631:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0cc00/0xc6b31a1b598eb092 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740554.897639:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8f0d98cd3100) 00010000:00010000:2.0:1790740554.897642:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740554.897645:0:14356:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0cc00/0xc6b31a1b598eb092 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740554.897651:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0cc00/0xc6b31a1b598eb092 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740554.898093:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0d200/0xc6b31a1b598eb084 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee8bb expref: 10 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740554.898122:0:14356:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0c000/0xc6b31a1b598eb099 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee8bb expref: 9 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740554.898129:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f0d98cd3c00) 00010000:00010000:2.0:1790740554.898131:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740554.898133:0:14356:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0c84d0c000, rc 0) 00000100:00100000:2.0:1790740554.898208:0:14356:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd86c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:94f64522-bacd-439b-9eb0-785368ef5e14+9:14404:x1877727133155840:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 Request processed in 1467us (1679us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1790740554.898217:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 16 00000100:00100000:3.0:1790740554.910220:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740554.910837:0:14358:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133155968 00000100:00100000:0.0:1790740554.910848:0:14358:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133155968 00000100:00100000:0.0:1790740554.910906:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 17 00000100:00100000:0.0:1790740554.910917:0:14358:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db6dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:94f64522-bacd-439b-9eb0-785368ef5e14+9:14404:x1877727133155968:12345-192.168.203.58@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1790740554.911015:0:14358:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db6dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:94f64522-bacd-439b-9eb0-785368ef5e14+9:14404:x1877727133155968:12345-192.168.203.58@tcp:59:lhsmtool_posix.0 Request processed in 100us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740554.911022:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 17 00000100:00100000:3.0:1790740554.961560:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740554.961752:0:14357:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133156096 00000100:00100000:0.0:1790740554.961762:0:14357:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133156096 00000100:00100000:0.0:1790740554.961826:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 18 00000100:00100000:0.0:1790740554.961846:0:14357:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db6dc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:94f64522-bacd-439b-9eb0-785368ef5e14+9:14410:x1877727133156096:12345-192.168.203.58@tcp:101:lfs.0 00010000:00010000:0.0:1790740554.961865:0:14357:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740554.961886:0:14357:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e000/0xc6b31a1b598eb0a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee8c2 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740554.961970:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e800/0xc6b31a1b598eb0ae lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740554.961987:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e800/0xc6b31a1b598eb0ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740554.961998:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e800/0xc6b31a1b598eb0ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740554.962013:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598eb0b5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740554.962021:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598eb0b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740554.962027:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598eb0b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740554.962247:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e800/0xc6b31a1b598eb0ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740554.962255:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e800/0xc6b31a1b598eb0ae lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740554.962262:0:14357:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e800/0xc6b31a1b598eb0ae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740554.962267:0:14357:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132e800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1790740554.962272:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e800/0xc6b31a1b598eb0ae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740554.962287:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e800/0xc6b31a1b598eb0ae lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740554.962299:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0d84a1e200) 00010000:00010000:0.0:1790740554.962302:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740554.962307:0:14357:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e800/0xc6b31a1b598eb0ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740554.962314:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e800/0xc6b31a1b598eb0ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740554.962325:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598eb0b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740554.962331:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598eb0b5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740554.962337:0:14357:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598eb0b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740554.962342:0:14357:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132ee00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1790740554.962345:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598eb0b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740554.962350:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598eb0b5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740554.962355:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8f0d84bf8d00) 00010000:00010000:0.0:1790740554.962357:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740554.962360:0:14357:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598eb0b5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740554.962374:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598eb0b5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740554.962405:0:14357:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e000/0xc6b31a1b598eb0a7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee8c2 expref: 10 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740554.962415:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0d84a1e200) 00010000:00010000:0.0:1790740554.962417:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740554.962421:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e000/0xc6b31a1b598eb0a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee8c2 expref: 10 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740554.962429:0:14357:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0dc132e000, rc 0) 00000100:00100000:0.0:1790740554.962501:0:14357:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db6dc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:94f64522-bacd-439b-9eb0-785368ef5e14+9:14410:x1877727133156096:12345-192.168.203.58@tcp:101:lfs.0 Request processed in 665us (951us total) trans 0 rc 301/301 00000100:00100000:0.0:1790740554.962508:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 18 00000100:00100000:3.0:1790740554.967981:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740554.968253:0:14365:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133156224 00000100:00100000:1.0:1790740554.968264:0:14365:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133156224 00000100:00100000:1.0:1790740554.968330:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 0 00000100:00100000:1.0:1790740554.968340:0:14365:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db6dc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:94f64522-bacd-439b-9eb0-785368ef5e14+9:14410:x1877727133156224:12345-192.168.203.58@tcp:700:lfs.0 00000100:00100000:1.0:1790740554.968433:0:14365:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db6dc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:94f64522-bacd-439b-9eb0-785368ef5e14+9:14410:x1877727133156224:12345-192.168.203.58@tcp:700:lfs.0 Request processed in 94us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740554.968441:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 0 00000100:00100000:3.0:1790740554.970648:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740554.980248:0:14356:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133156480 00000100:00100000:2.0:1790740554.980264:0:14356:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133156480 00000100:00100000:2.0:1790740554.980329:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 19 00000100:00100000:2.0:1790740554.980338:0:14356:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db6dc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:94f64522-bacd-439b-9eb0-785368ef5e14+9:14410:x1877727133156480:12345-192.168.203.58@tcp:36:lfs.0 00010000:00010000:2.0:1790740554.980402:0:14356:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740554.980427:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977c00/0xc6b31a1b598eafea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee83d expref: 9 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740554.980446:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0d84a1e200) 00010000:00010000:2.0:1790740554.980451:0:14356:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790740554.980705:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0d200/0xc6b31a1b598eb0bc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740554.980720:0:14356:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ec00/0xc6b31a1b598eb022 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee89f expref: 5 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740554.980728:0:14356:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0d200/0xc6b31a1b598eb0bc lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740554.980770:0:14356:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ec00/0xc6b31a1b598eb022 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee89f expref: 5 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740554.980784:0:14356:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ec00/0xc6b31a1b598eb022 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee89f expref: 5 pid: 14356 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740554.980797:0:14356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd7d4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14356:1877727158312448:192.168.203.58@tcp:104: 00000100:00100000:2.0:1790740554.981026:0:14356:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0dbda3d480 going to sleep for 11 seconds 00000100:00100000:2.0:1790740554.983264:0:14356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd7d4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14356:1877727158312448:192.168.203.58@tcp:104: 00010000:00010000:2.0:1790740554.983291:0:14356:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0d200/0xc6b31a1b598eb0bc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740554.986432:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740554.986639:0:14342:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133156608 00000100:00100000:0.0:1790740554.986648:0:14342:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133156608 00010000:00010000:0.0:1790740554.986706:0:14342:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ec00/0xc6b31a1b598eb022 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee89f expref: 6 pid: 14356 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740554.986743:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 9 00000100:00100000:0.0:1790740554.986753:0:14342:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db6dc0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1afbbc59-4fef-403d-8587-7e85da474903+6:2370:x1877727133156608:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790740554.986769:0:14342:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740554.986776:0:14342:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ec00/0xc6b31a1b598eb022 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee89f expref: 6 pid: 14356 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740554.986800:0:14342:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ec00/0xc6b31a1b598eb022 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee89f expref: 6 pid: 14356 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740554.986824:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ec00/0xc6b31a1b598eb022 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee89f expref: 6 pid: 14356 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740554.986850:0:14342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0d84a1e200) 00010000:00010000:0.0:1790740554.986857:0:14342:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0d200/0xc6b31a1b598eb0bc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740554.986865:0:14342:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0d200/0xc6b31a1b598eb0bc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740554.986873:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0d200/0xc6b31a1b598eb0bc lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740554.986902:0:14342:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740554.986959:0:14342:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db6dc0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1afbbc59-4fef-403d-8587-7e85da474903+5:2370:x1877727133156608:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 208us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740554.986968:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 9 00010000:00010000:2.0:1790740554.987213:0:14356:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0d200/0xc6b31a1b598eb0bc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740554.987222:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0d200/0xc6b31a1b598eb0bc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740554.987247:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0cc00/0xc6b31a1b598eb0c3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740554.987257:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0cc00/0xc6b31a1b598eb0c3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740554.987265:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0cc00/0xc6b31a1b598eb0c3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740554.988745:0:14356:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1790740554.988765:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0d200/0xc6b31a1b598eb0bc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740554.988775:0:14356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0d200/0xc6b31a1b598eb0bc lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740554.988781:0:14356:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0d200/0xc6b31a1b598eb0bc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740554.988787:0:14356:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0c84d0d200 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740554.988791:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0d200/0xc6b31a1b598eb0bc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740554.988799:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0d200/0xc6b31a1b598eb0bc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740554.988812:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0d84a1e200) 00010000:00010000:2.0:1790740554.988815:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740554.988819:0:14356:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0d200/0xc6b31a1b598eb0bc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740554.988825:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0d200/0xc6b31a1b598eb0bc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790740554.988842:0:14356:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000c8748083 reply state 00000000a75c62d1 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0cc00/0xc6b31a1b598eb0c3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740554.988850:0:14356:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790740554.988932:0:14356:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db6dc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:94f64522-bacd-439b-9eb0-785368ef5e14+10:14410:x1877727133156480:12345-192.168.203.58@tcp:36:lfs.0 Request processed in 8593us (18288us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1790740554.988940:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 19 00010000:00010000:0.0:1790740554.991037:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0cc00/0xc6b31a1b598eb0c3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740554.991053:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0cc00/0xc6b31a1b598eb0c3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740554.991060:0:3289:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0cc00/0xc6b31a1b598eb0c3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740554.991081:0:3289:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0c84d0cc00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1790740554.991086:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0cc00/0xc6b31a1b598eb0c3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740554.991094:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0cc00/0xc6b31a1b598eb0c3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740554.991106:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8f0d98cd3100) 00010000:00010000:0.0:1790740554.991109:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740554.991112:0:3289:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0cc00/0xc6b31a1b598eb0c3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740554.991118:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0cc00/0xc6b31a1b598eb0c3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740555.056804:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740555.127052:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740555.127144:0:14358:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133156736 00000100:00100000:0.0:1790740555.127154:0:14358:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133156736 00000100:00100000:0.0:1790740555.127274:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 20 00000100:00100000:0.0:1790740555.127286:0:14358:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:94f64522-bacd-439b-9eb0-785368ef5e14+9:14418:x1877727133156736:12345-192.168.203.58@tcp:101:lctl.0 00010000:00010000:0.0:1790740555.127308:0:14358:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740555.127329:0:14358:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598eb0ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee8c9 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.127434:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e800/0xc6b31a1b598eb0d1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.127449:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e800/0xc6b31a1b598eb0d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.127480:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e800/0xc6b31a1b598eb0d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790740555.127530:0:14358:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790740555.127535:0:14358:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790740555.127598:0:14358:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e800/0xc6b31a1b598eb0d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.127623:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598eb0ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee8c9 expref: 11 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.127641:0:14358:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e800/0xc6b31a1b598eb0d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee8c9 expref: 10 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.127650:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0d84bf8d00) 00010000:00010000:0.0:1790740555.127653:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790740555.127656:0:14358:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0dc132e800, rc 0) 00000100:00100000:0.0:1790740555.127709:0:14358:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:94f64522-bacd-439b-9eb0-785368ef5e14+10:14418:x1877727133156736:12345-192.168.203.58@tcp:101:lctl.0 Request processed in 426us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740555.127716:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 20 00000100:00080000:2.0:1790740555.127775:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790740555.147511:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740555.147754:0:14356:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133156864 00000100:00100000:2.0:1790740555.147764:0:14356:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133156864 00000100:00080000:0.0:1790740555.147966:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790740555.148040:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 21 00000100:00100000:2.0:1790740555.148053:0:14356:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db6dc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1afbbc59-4fef-403d-8587-7e85da474903+5:14419:x1877727133156864:12345-192.168.203.58@tcp:101:lfs.0 00010000:00010000:2.0:1790740555.148081:0:14356:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740555.148101:0:14356:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0ca00/0xc6b31a1b598eb0d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee8d0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740555.148159:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0d400/0xc6b31a1b598eb0df lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740555.148172:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0d400/0xc6b31a1b598eb0df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740555.148195:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0d400/0xc6b31a1b598eb0df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740555.148229:0:14356:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790740555.148233:0:14356:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790740555.148251:0:14356:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0d400/0xc6b31a1b598eb0df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740555.148274:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0ca00/0xc6b31a1b598eb0d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee8d0 expref: 7 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740555.148292:0:14356:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0d400/0xc6b31a1b598eb0df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee8d0 expref: 6 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740555.148301:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0d84bf8d00) 00010000:00010000:2.0:1790740555.148315:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790740555.148320:0:14356:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0c84d0d400, rc 0) 00000100:00100000:2.0:1790740555.148383:0:14356:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db6dc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1afbbc59-4fef-403d-8587-7e85da474903+6:14419:x1877727133156864:12345-192.168.203.58@tcp:101:lfs.0 Request processed in 333us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740555.151488:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740555.151563:0:14358:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1790740555.151600:0:14358:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1790740555.152077:0:14358:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133156992 00000100:00100000:0.0:1790740555.152086:0:14358:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133156992 00000100:00100000:2.0:1790740555.155066:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 21 00000100:00100000:0.0:1790740555.157195:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 22 00000100:00100000:0.0:1790740555.157223:0:14358:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd86d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1afbbc59-4fef-403d-8587-7e85da474903+6:14419:x1877727133156992:12345-192.168.203.58@tcp:101:lfs.0 00010000:00010000:0.0:1790740555.157248:0:14358:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740555.157284:0:14358:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598eb0e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee8d7 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.157356:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f400/0xc6b31a1b598eb0ed lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.157371:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f400/0xc6b31a1b598eb0ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.157383:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f400/0xc6b31a1b598eb0ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.157397:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598eb0f4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.157404:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598eb0f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.157410:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598eb0f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.157495:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ec00/0xc6b31a1b598eb0fb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.157504:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ec00/0xc6b31a1b598eb0fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.157511:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ec00/0xc6b31a1b598eb0fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790740555.157542:0:14358:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790740555.157545:0:14358:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790740555.157567:0:14358:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ec00/0xc6b31a1b598eb0fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.158782:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f400/0xc6b31a1b598eb0ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.158788:0:14358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f400/0xc6b31a1b598eb0ed lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.158795:0:14358:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f400/0xc6b31a1b598eb0ed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.158800:0:14358:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132f400 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1790740555.158804:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f400/0xc6b31a1b598eb0ed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.158811:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f400/0xc6b31a1b598eb0ed lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.158825:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0d84bf8d00) 00010000:00010000:0.0:1790740555.158828:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740555.158832:0:14358:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f400/0xc6b31a1b598eb0ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.158903:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f400/0xc6b31a1b598eb0ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.158919:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598eb0f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.158926:0:14358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598eb0f4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.158937:0:14358:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598eb0f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.158954:0:14358:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132e600 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1790740555.158957:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598eb0f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.158963:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598eb0f4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.159040:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8f0d84bf8c00) 00010000:00010000:0.0:1790740555.159044:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740555.159047:0:14358:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598eb0f4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.159053:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598eb0f4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.159266:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598eb0e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee8d7 expref: 8 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.159281:0:14358:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ec00/0xc6b31a1b598eb0fb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee8d7 expref: 7 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.159288:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f0d84bf8300) 00010000:00010000:0.0:1790740555.159291:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790740555.159294:0:14358:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0dc132ec00, rc 0) 00000100:00100000:0.0:1790740555.159371:0:14358:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd86d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1afbbc59-4fef-403d-8587-7e85da474903+7:14419:x1877727133156992:12345-192.168.203.58@tcp:101:lfs.0 Request processed in 2162us (7889us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740555.163960:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740555.164059:0:14357:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133157248 00000100:00100000:1.0:1790740555.164215:0:14357:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133157248 00000100:00100000:1.0:1790740555.164298:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 23 00000100:00100000:1.0:1790740555.164308:0:14357:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd7d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1afbbc59-4fef-403d-8587-7e85da474903+8:14419:x1877727133157248:12345-192.168.203.58@tcp:101:lfs.0 00010000:00010000:1.0:1790740555.164329:0:14357:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740555.164362:0:14357:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598eb102 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee8de expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790740555.164640:0:14357:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1790740555.164764:0:14357:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598eb102 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee8de expref: 10 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740555.164778:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0d84bf8d00) 00010000:00010000:1.0:1790740555.164781:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790740555.164786:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598eb102 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee8de expref: 10 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740555.164800:0:14357:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9f976000, rc 0) 00000100:00100000:1.0:1790740555.164859:0:14357:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd7d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1afbbc59-4fef-403d-8587-7e85da474903+9:14419:x1877727133157248:12345-192.168.203.58@tcp:101:lfs.0 Request processed in 552us (909us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1790740555.164866:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 23 00000100:00100000:0.0:1790740555.165694:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 22 00000100:00100000:1.0:1790740555.171444:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740555.171534:0:16583:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133157504 00000100:00100000:3.0:1790740555.171544:0:16583:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133157504 00000100:00100000:3.0:1790740555.171652:0:16583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 24 00000100:00100000:3.0:1790740555.171664:0:16583:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1afbbc59-4fef-403d-8587-7e85da474903+8:14419:x1877727133157504:12345-192.168.203.58@tcp:36:lfs.0 00010000:00010000:3.0:1790740555.171730:0:16583:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740555.171758:0:16583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ec00/0xc6b31a1b598eb0fb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee8d7 expref: 8 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740555.171777:0:16583:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f0d84bf8300) 00010000:00010000:3.0:1790740555.171788:0:16583:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790740555.171813:0:16583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598eb110 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740555.171827:0:16583:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598eb110 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740555.171838:0:16583:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598eb110 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790740555.172854:0:16583:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000df929523 reply state 00000000567f9ea2 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598eb110 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740555.172868:0:16583:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1790740555.172877:0:16583:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1790740555.172963:0:16583:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1afbbc59-4fef-403d-8587-7e85da474903+9:14419:x1877727133157504:12345-192.168.203.58@tcp:36:lfs.0 Request processed in 1300us (1527us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1790740555.172971:0:16583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 24 00000100:00100000:3.0:1790740555.174480:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00010000:00010000:2.0:1790740555.174569:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598eb110 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740555.174620:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598eb110 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740555.174627:0:3290:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598eb110 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740555.174634:0:3290:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0ee00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740555.174639:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598eb110 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740555.174647:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598eb110 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740555.174662:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f0d944f6200) 00010000:00010000:2.0:1790740555.174665:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1790740555.174671:0:3290:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598eb110 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740555.174676:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598eb110 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740555.175324:0:14359:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133157760 00000100:00100000:0.0:1790740555.175349:0:14359:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133157760 00000100:00100000:0.0:1790740555.175399:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 2 00000100:00100000:0.0:1790740555.175408:0:14359:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db6dc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1afbbc59-4fef-403d-8587-7e85da474903+8:14419:x1877727133157760:12345-192.168.203.58@tcp:35:lfs.0 00000100:00100000:0.0:1790740555.175657:0:14359:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db6dc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1afbbc59-4fef-403d-8587-7e85da474903+9:14419:x1877727133157760:12345-192.168.203.58@tcp:35:lfs.0 Request processed in 250us (1181us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1790740555.175665:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 2 00000100:00100000:2.0:1790740555.181022:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740555.181229:0:14357:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133158016 00000100:00100000:1.0:1790740555.181240:0:14357:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133158016 00000100:00100000:1.0:1790740555.181303:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 25 00000100:00100000:1.0:1790740555.181313:0:14357:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0c86432a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1afbbc59-4fef-403d-8587-7e85da474903+9:14419:x1877727133158016:12345-192.168.203.58@tcp:101:lfs.0 00010000:00010000:1.0:1790740555.181350:0:14357:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740555.181369:0:14357:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598eb117 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee8e5 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740555.181451:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976a00/0xc6b31a1b598eb11e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740555.181484:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976a00/0xc6b31a1b598eb11e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740555.181494:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976a00/0xc6b31a1b598eb11e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740555.181510:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977400/0xc6b31a1b598eb125 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740555.181517:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977400/0xc6b31a1b598eb125 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740555.181522:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977400/0xc6b31a1b598eb125 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790740555.181650:0:14357:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1790740555.181740:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976a00/0xc6b31a1b598eb11e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740555.181750:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976a00/0xc6b31a1b598eb11e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740555.181757:0:14357:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976a00/0xc6b31a1b598eb11e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740555.181762:0:14357:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f976a00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1790740555.181767:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976a00/0xc6b31a1b598eb11e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740555.181774:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976a00/0xc6b31a1b598eb11e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740555.181798:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0d84bf8d00) 00010000:00010000:1.0:1790740555.181801:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740555.181807:0:14357:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976a00/0xc6b31a1b598eb11e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740555.181813:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976a00/0xc6b31a1b598eb11e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740555.181826:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977400/0xc6b31a1b598eb125 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740555.181832:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977400/0xc6b31a1b598eb125 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740555.181838:0:14357:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977400/0xc6b31a1b598eb125 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740555.181844:0:14357:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f977400 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1790740555.181847:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977400/0xc6b31a1b598eb125 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740555.181852:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977400/0xc6b31a1b598eb125 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740555.181859:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8f0d84a1ee00) 00010000:00010000:1.0:1790740555.181861:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740555.181864:0:14357:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977400/0xc6b31a1b598eb125 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740555.181868:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977400/0xc6b31a1b598eb125 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740555.181918:0:14357:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598eb117 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee8e5 expref: 11 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740555.181928:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0d84bf8d00) 00010000:00010000:1.0:1790740555.181931:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790740555.181934:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598eb117 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee8e5 expref: 11 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740555.181944:0:14357:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9f976000, rc 0) 00000100:00100000:1.0:1790740555.182008:0:14357:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0c86432a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1afbbc59-4fef-403d-8587-7e85da474903+10:14419:x1877727133158016:12345-192.168.203.58@tcp:101:lfs.0 Request processed in 697us (996us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1790740555.182016:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 25 00000100:00100000:3.0:1790740555.185451:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740555.189204:0:14356:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133158144 00000100:00100000:2.0:1790740555.189235:0:14356:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133158144 00000100:00100000:2.0:1790740555.189318:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 26 00000100:00100000:2.0:1790740555.189328:0:14356:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db6dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1afbbc59-4fef-403d-8587-7e85da474903+10:14419:x1877727133158144:12345-192.168.203.58@tcp:101:lfs.0 00010000:00010000:2.0:1790740555.189354:0:14356:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740555.189377:0:14356:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0c600/0xc6b31a1b598eb133 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee8ec expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740555.189463:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0c800/0xc6b31a1b598eb13a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740555.189477:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0c800/0xc6b31a1b598eb13a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740555.189488:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0c800/0xc6b31a1b598eb13a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740555.189986:0:14356:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790740555.189991:0:14356:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790740555.190012:0:14356:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0c800/0xc6b31a1b598eb13a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740555.190040:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0c600/0xc6b31a1b598eb133 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee8ec expref: 12 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740555.190056:0:14356:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0c800/0xc6b31a1b598eb13a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee8ec expref: 11 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740555.190065:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f0d98cd3000) 00010000:00010000:2.0:1790740555.190067:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790740555.190071:0:14356:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0c84d0c800, rc 0) 00000100:00100000:2.0:1790740555.190149:0:14356:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db6dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1afbbc59-4fef-403d-8587-7e85da474903+11:14419:x1877727133158144:12345-192.168.203.58@tcp:101:lfs.0 Request processed in 823us (4706us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740555.190157:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 26 00000100:00100000:1.0:1790740555.195381:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740555.196126:0:14359:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133158272 00000100:00100000:0.0:1790740555.196137:0:14359:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133158272 00000100:00100000:0.0:1790740555.196201:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 3 00000100:00100000:0.0:1790740555.196212:0:14359:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1afbbc59-4fef-403d-8587-7e85da474903+11:14419:x1877727133158272:12345-192.168.203.58@tcp:37:lfs.0 00000100:00100000:0.0:1790740555.200418:0:14359:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1afbbc59-4fef-403d-8587-7e85da474903+11:14419:x1877727133158272:12345-192.168.203.58@tcp:37:lfs.0 Request processed in 4199us (5037us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740555.200429:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 3 00000100:00100000:3.0:1790740555.204627:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740555.204807:0:14360:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133158528 00000100:00100000:2.0:1790740555.204818:0:14360:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133158528 00000100:00100000:2.0:1790740555.204866:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 4 00000100:00100000:2.0:1790740555.204876:0:14360:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d848bfc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1afbbc59-4fef-403d-8587-7e85da474903+11:14419:x1877727133158528:12345-192.168.203.58@tcp:35:lfs.0 00000100:00100000:2.0:1790740555.205104:0:14360:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d848bfc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1afbbc59-4fef-403d-8587-7e85da474903+12:14419:x1877727133158528:12345-192.168.203.58@tcp:35:lfs.0 Request processed in 229us (486us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1790740555.205112:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 4 00000100:00100000:1.0:1790740555.267395:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740555.267980:0:14357:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133158656 00000100:00100000:0.0:1790740555.267991:0:14357:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133158656 00000100:00100000:0.0:1790740555.268110:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 27 00000100:00100000:0.0:1790740555.268121:0:14357:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:94f64522-bacd-439b-9eb0-785368ef5e14+10:14425:x1877727133158656:12345-192.168.203.58@tcp:101:bash.0 00010000:00010000:0.0:1790740555.268143:0:14357:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740555.268163:0:14357:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598eb141 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee8f3 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.268237:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598eb148 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.268252:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598eb148 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.268263:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598eb148 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.268293:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f400/0xc6b31a1b598eb14f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.268301:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f400/0xc6b31a1b598eb14f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.268308:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f400/0xc6b31a1b598eb14f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.268403:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ec00/0xc6b31a1b598eb156 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.268412:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ec00/0xc6b31a1b598eb156 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.268419:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ec00/0xc6b31a1b598eb156 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790740555.268666:0:14357:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790740555.268671:0:14357:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790740555.268722:0:14357:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ec00/0xc6b31a1b598eb156 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.268734:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598eb148 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.268740:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598eb148 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.268747:0:14357:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598eb148 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.268763:0:14357:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132e600 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1790740555.268767:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598eb148 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.268774:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598eb148 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.268786:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0d84bf8d00) 00010000:00010000:0.0:1790740555.268789:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740555.268794:0:14357:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598eb148 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.268800:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598eb148 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.268812:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f400/0xc6b31a1b598eb14f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.268818:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f400/0xc6b31a1b598eb14f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.268824:0:14357:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f400/0xc6b31a1b598eb14f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.268828:0:14357:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132f400 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1790740555.268831:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f400/0xc6b31a1b598eb14f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.268836:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f400/0xc6b31a1b598eb14f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.268853:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8f0d84bf8c00) 00010000:00010000:0.0:1790740555.268856:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740555.268858:0:14357:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f400/0xc6b31a1b598eb14f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.268863:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f400/0xc6b31a1b598eb14f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.268895:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598eb141 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee8f3 expref: 12 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.268905:0:14357:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ec00/0xc6b31a1b598eb156 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee8f3 expref: 11 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.268912:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f0d98cd3000) 00010000:00010000:0.0:1790740555.268914:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1790740555.268916:0:14357:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0dc132ec00, rc 0) 00000100:00100000:0.0:1790740555.268974:0:14357:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:94f64522-bacd-439b-9eb0-785368ef5e14+11:14425:x1877727133158656:12345-192.168.203.58@tcp:101:bash.0 Request processed in 856us (1588us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740555.268980:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 27 00000100:00100000:3.0:1790740555.273171:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740555.273282:0:16583:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133158912 00000100:00100000:1.0:1790740555.273291:0:16583:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133158912 00000100:00100000:1.0:1790740555.273343:0:16583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 28 00000100:00100000:1.0:1790740555.273351:0:16583:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db6dc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:94f64522-bacd-439b-9eb0-785368ef5e14+11:14425:x1877727133158912:12345-192.168.203.58@tcp:101:bash.0 00010000:00010000:1.0:1790740555.273370:0:16583:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740555.273388:0:16583:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976a00/0xc6b31a1b598eb15d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee8fa expref: -99 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740555.273504:0:16583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977600/0xc6b31a1b598eb164 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740555.273684:0:16583:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0c800/0xc6b31a1b598eb13a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee8ec expref: 11 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740555.273808:0:16583:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977600/0xc6b31a1b598eb164 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740555.273844:0:16583:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0c800/0xc6b31a1b598eb13a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee8ec expref: 11 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740555.273856:0:16583:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0c800/0xc6b31a1b598eb13a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee8ec expref: 11 pid: 14356 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740555.273869:0:16583:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda72a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16583:1877727158312576:192.168.203.58@tcp:104: 00000100:00100000:1.0:1790740555.273964:0:16583:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d980199c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790740555.277270:0:16583:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda72a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16583:1877727158312576:192.168.203.58@tcp:104: 00010000:00010000:3.0:1790740555.277297:0:16583:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977600/0xc6b31a1b598eb164 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740555.279420:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740555.279513:0:14341:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133159040 00000100:00100000:0.0:1790740555.279522:0:14341:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133159040 00010000:00010000:0.0:1790740555.279561:0:14341:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0c800/0xc6b31a1b598eb13a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee8ec expref: 12 pid: 14356 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740555.279630:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 10 00000100:00100000:0.0:1790740555.279647:0:14341:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db6dc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1afbbc59-4fef-403d-8587-7e85da474903+12:2370:x1877727133159040:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790740555.279679:0:14341:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740555.279687:0:14341:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0c800/0xc6b31a1b598eb13a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee8ec expref: 12 pid: 14356 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.279699:0:14341:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0c800/0xc6b31a1b598eb13a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee8ec expref: 12 pid: 14356 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.279726:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0c800/0xc6b31a1b598eb13a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee8ec expref: 12 pid: 14356 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.279744:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f0d98cd3000) 00010000:00010000:0.0:1790740555.279749:0:14341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977600/0xc6b31a1b598eb164 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.279759:0:14341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977600/0xc6b31a1b598eb164 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.279766:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977600/0xc6b31a1b598eb164 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.279789:0:14341:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740555.279848:0:14341:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db6dc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1afbbc59-4fef-403d-8587-7e85da474903+11:2370:x1877727133159040:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 210us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740555.279857:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 10 00010000:00010000:1.0:1790740555.280292:0:16583:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977600/0xc6b31a1b598eb164 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740555.280300:0:16583:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977600/0xc6b31a1b598eb164 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740555.280322:0:16583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976400/0xc6b31a1b598eb16b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740555.280331:0:16583:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976400/0xc6b31a1b598eb16b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740555.280339:0:16583:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976400/0xc6b31a1b598eb16b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740555.281046:0:16583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598eb172 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740555.281066:0:16583:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598eb172 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740555.281835:0:16583:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598eb172 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790740555.281849:0:16583:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1790740555.281885:0:16583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977600/0xc6b31a1b598eb164 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740555.281892:0:16583:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977600/0xc6b31a1b598eb164 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740555.281898:0:16583:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977600/0xc6b31a1b598eb164 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740555.281904:0:16583:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f977600 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1790740555.281908:0:16583:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977600/0xc6b31a1b598eb164 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740555.281915:0:16583:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977600/0xc6b31a1b598eb164 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740555.281926:0:16583:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f0d98cd3000) 00010000:00010000:1.0:1790740555.281929:0:16583:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740555.281933:0:16583:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977600/0xc6b31a1b598eb164 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740555.281939:0:16583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977600/0xc6b31a1b598eb164 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790740555.281953:0:16583:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000007178a60b reply state 00000000c3622536 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976400/0xc6b31a1b598eb16b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740555.281971:0:16583:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790740555.282011:0:16583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976a00/0xc6b31a1b598eb15d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee8fa expref: 14 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740555.282027:0:16583:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598eb172 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee8fa expref: 13 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740555.282034:0:16583:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f0d84a1e200) 00010000:00010000:1.0:1790740555.282036:0:16583:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1790740555.282039:0:16583:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9f976600, rc 0) 00000100:00100000:1.0:1790740555.282868:0:16583:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db6dc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:94f64522-bacd-439b-9eb0-785368ef5e14+14:14425:x1877727133158912:12345-192.168.203.58@tcp:101:bash.0 Request processed in 9511us (9700us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1790740555.282879:0:16583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 28 00010000:00010000:0.0:1790740555.289038:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976400/0xc6b31a1b598eb16b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.289057:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976400/0xc6b31a1b598eb16b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.289144:0:3289:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976400/0xc6b31a1b598eb16b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.289151:0:3289:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f976400 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1790740555.289156:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976400/0xc6b31a1b598eb16b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.289164:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976400/0xc6b31a1b598eb16b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.289190:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8f0d84a1ee00) 00010000:00010000:0.0:1790740555.289194:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740555.289199:0:3289:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976400/0xc6b31a1b598eb16b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.289205:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976400/0xc6b31a1b598eb16b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740555.304736:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740555.304867:0:14358:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133159168 00000100:00100000:3.0:1790740555.304877:0:14358:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133159168 00000100:00100000:3.0:1790740555.304937:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 29 00000100:00100000:3.0:1790740555.304948:0:14358:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0c86432680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:94f64522-bacd-439b-9eb0-785368ef5e14+13:14425:x1877727133159168:12345-192.168.203.58@tcp:101:bash.0 00010000:00010000:3.0:1790740555.304975:0:14358:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740555.304998:0:14358:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598eb180 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee901 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740555.305071:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598eb187 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740555.305087:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598eb187 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740555.305098:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598eb187 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790740555.305138:0:14358:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1790740555.305142:0:14358:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790740555.305163:0:14358:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598eb187 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740555.305202:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598eb187 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740555.305227:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598eb180 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee901 expref: 15 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740555.305245:0:14358:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598eb187 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee901 expref: 14 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740555.305253:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f0d84a1e200) 00010000:00010000:3.0:1790740555.305255:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790740555.305259:0:14358:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0db6c0ee00, rc 0) 00000100:00100000:3.0:1790740555.305324:0:14358:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0c86432680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:94f64522-bacd-439b-9eb0-785368ef5e14+14:14425:x1877727133159168:12345-192.168.203.58@tcp:101:bash.0 Request processed in 378us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740555.305332:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 29 00000100:00100000:3.0:1790740555.309927:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740555.310055:0:14360:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133159424 00000100:00100000:2.0:1790740555.310065:0:14360:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133159424 00000100:00100000:2.0:1790740555.310119:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 5 00000100:00100000:2.0:1790740555.310127:0:14360:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db6dc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:94f64522-bacd-439b-9eb0-785368ef5e14+14:14425:x1877727133159424:12345-192.168.203.58@tcp:35:bash.0 00000100:00100000:2.0:1790740555.310472:0:14360:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db6dc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:94f64522-bacd-439b-9eb0-785368ef5e14+15:14425:x1877727133159424:12345-192.168.203.58@tcp:35:bash.0 Request processed in 345us (554us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1790740555.310481:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 5 00000040:00080000:1.0:1790740555.441496:0:14391:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1790740555.451540:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740555.452507:0:14357:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133159680 00000100:00100000:0.0:1790740555.452518:0:14357:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133159680 00000100:00100000:1.0:1790740555.452878:0:16583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 30 00000100:00100000:1.0:1790740555.452892:0:16583:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:94f64522-bacd-439b-9eb0-785368ef5e14+15:14435:x1877727133159680:12345-192.168.203.58@tcp:101:lfs.0 00010000:00010000:1.0:1790740555.452918:0:16583:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740555.452938:0:16583:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977600/0xc6b31a1b598eb18e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee908 expref: -99 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790740555.453027:0:16583:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1790740555.453392:0:16583:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977600/0xc6b31a1b598eb18e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee908 expref: 17 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740555.453406:0:16583:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0d84bf8d00) 00010000:00010000:1.0:1790740555.453421:0:16583:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790740555.453428:0:16583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977600/0xc6b31a1b598eb18e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee908 expref: 17 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740555.453506:0:16583:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9f977600, rc 0) 00000100:00100000:1.0:1790740555.453892:0:16583:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:94f64522-bacd-439b-9eb0-785368ef5e14+16:14435:x1877727133159680:12345-192.168.203.58@tcp:101:lfs.0 Request processed in 1002us (2359us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1790740555.453900:0:16583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 30 00000100:00100000:3.0:1790740555.458557:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740555.458860:0:14360:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133159936 00000100:00100000:2.0:1790740555.458870:0:14360:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133159936 00000100:00100000:2.0:1790740555.458925:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 6 00000100:00100000:2.0:1790740555.458935:0:14360:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d9018ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:94f64522-bacd-439b-9eb0-785368ef5e14+16:14435:x1877727133159936:12345-192.168.203.58@tcp:35:lfs.0 00000100:00100000:2.0:1790740555.459183:0:14360:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d9018ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:94f64522-bacd-439b-9eb0-785368ef5e14+17:14435:x1877727133159936:12345-192.168.203.58@tcp:35:lfs.0 Request processed in 240us (626us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1790740555.459192:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 6 00000100:00100000:3.0:1790740555.518887:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740555.519024:0:14358:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133160192 00000100:00100000:0.0:1790740555.519034:0:14358:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133160192 00000100:00100000:0.0:1790740555.519102:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 31 00000100:00100000:0.0:1790740555.519111:0:14358:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d9018f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:94f64522-bacd-439b-9eb0-785368ef5e14+17:14438:x1877727133160192:12345-192.168.203.58@tcp:101:lfs.0 00010000:00010000:0.0:1790740555.519135:0:14358:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740555.519156:0:14358:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598eb19c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee90f expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.519259:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f400/0xc6b31a1b598eb1a3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.519286:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f400/0xc6b31a1b598eb1a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.519299:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f400/0xc6b31a1b598eb1a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790740555.519311:0:14358:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1790740555.519602:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598eb19c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee90f expref: 20 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.519623:0:14358:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f400/0xc6b31a1b598eb1a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee90f expref: 19 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.519632:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f0d84a1e200) 00010000:00010000:0.0:1790740555.519635:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790740555.519639:0:14358:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0dc132f400, rc 0) 00000100:00100000:0.0:1790740555.519831:0:14358:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d9018f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:94f64522-bacd-439b-9eb0-785368ef5e14+19:14438:x1877727133160192:12345-192.168.203.58@tcp:101:lfs.0 Request processed in 719us (950us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1790740555.519839:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 31 00000100:00100000:3.0:1790740555.523059:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740555.523118:0:14357:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133160320 00000100:00100000:0.0:1790740555.523126:0:14357:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133160320 00000100:00100000:0.0:1790740555.523190:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 32 00000100:00100000:0.0:1790740555.523200:0:14357:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8498c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:94f64522-bacd-439b-9eb0-785368ef5e14+19:14438:x1877727133160320:12345-192.168.203.58@tcp:54:lfs.0 00010000:00010000:0.0:1790740555.523268:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598eb1b1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.523281:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598eb1b1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.523307:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598eb1b1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.523332:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598eb1b1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.523339:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598eb1b1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.523346:0:14357:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598eb1b1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.523351:0:14357:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132e600 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1790740555.523355:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598eb1b1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.523362:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598eb1b1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.523373:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f0d84a1e200) 00010000:00010000:0.0:1790740555.523376:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790740555.523381:0:14357:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598eb1b1 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740555.523387:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598eb1b1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740555.523528:0:14357:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8498c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:94f64522-bacd-439b-9eb0-785368ef5e14+19:14438:x1877727133160320:12345-192.168.203.58@tcp:54:lfs.0 Request processed in 328us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740555.523540:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 32 00000100:00100000:1.0:1790740555.524194:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740555.524912:0:14343:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133160448 00000100:00100000:3.0:1790740555.524921:0:14343:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133160448 00000100:00100000:3.0:1790740555.524970:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 0 00000100:00100000:3.0:1790740555.524980:0:14343:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:94f64522-bacd-439b-9eb0-785368ef5e14+19:2372:x1877727133160448:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790740555.524992:0:14343:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740555.525010:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f400/0xc6b31a1b598eb1a3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee90f expref: 19 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740555.525040:0:14343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f0d84a1e200) 00010000:00010000:3.0:1790740555.525044:0:14343:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790740555.525094:0:14343:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:94f64522-bacd-439b-9eb0-785368ef5e14+18:2372:x1877727133160448:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 116us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740555.525102:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 0 00000100:00100000:3.0:1790740555.525851:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740555.525897:0:14360:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133160704 00000100:00100000:2.0:1790740555.525904:0:14360:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133160704 00000100:00100000:2.0:1790740555.525943:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 7 00000100:00100000:2.0:1790740555.525951:0:14360:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8498d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:94f64522-bacd-439b-9eb0-785368ef5e14+18:14438:x1877727133160704:12345-192.168.203.58@tcp:35:lfs.0 00000100:00100000:2.0:1790740555.526160:0:14360:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8498d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:94f64522-bacd-439b-9eb0-785368ef5e14+19:14438:x1877727133160704:12345-192.168.203.58@tcp:35:lfs.0 Request processed in 209us (311us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1790740555.526167:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 7 00000100:00100000:0.0:1790740555.569115:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877727158313088:0@lo:400:kworker.0 00000100:00100000:0.0:1790740555.569193:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740555.569274:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1790740555.569281:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:752c79c8-24e4-410a-832f-aac51b94c085:3303:1877727158312704:0@lo:400:kworker.0 00000100:00100000:0.0:1790740555.569312:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740555.569821:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1877727158313216:0@lo:400:kworker.0 00000100:00100000:0.0:1790740555.569850:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740555.569883:0:14358:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158313088 00000100:00100000:0.0:1790740555.569890:0:14358:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158313088 00000100:00100000:0.0:1790740555.569926:0:14358:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158313216 00000100:00100000:0.0:1790740555.569928:0:14358:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158313216 00000100:00100000:0.0:1790740555.569953:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790740555.569961:0:14358:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd86d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877727158313088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740555.570009:0:14358:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd86d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877727158313088:12345-0@lo:400:kworker.0 Request processed in 48us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740555.570016:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790740555.570033:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790740555.570039:0:14358:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd86c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1877727158313216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740555.570062:0:14358:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd86c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1877727158313216:12345-0@lo:400:kworker.0 Request processed in 25us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740555.570067:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1790740555.570097:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790740555.570123:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1877727158313216:0@lo:400:kworker.0 00000100:00100000:0.0:1790740555.570132:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877727158313088:0@lo:400:kworker.0 00000100:00100000:2.0:1790740555.572487:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158312960:0@lo:400:kworker.0 00000100:00100000:2.0:1790740555.572893:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740555.573320:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1790740555.573331:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158312832:0@lo:400:kworker.0 00000100:00100000:2.0:1790740555.573358:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740555.573447:0:14349:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158312704 00000100:00100000:3.0:1790740555.573455:0:14349:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158312704 00000100:00100000:3.0:1790740555.573498:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1790740555.573507:0:14349:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1329850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:752c79c8-24e4-410a-832f-aac51b94c085+19:3303:x1877727158312704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740555.573564:0:14349:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1329850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:752c79c8-24e4-410a-832f-aac51b94c085+19:3303:x1877727158312704:12345-0@lo:400:kworker.0 Request processed in 58us (4250us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740555.573591:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1790740555.573627:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790740555.573637:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158313472:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790740555.573660:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:752c79c8-24e4-410a-832f-aac51b94c085:3303:1877727158312704:0@lo:400:kworker.0 00000100:00100000:3.0:1790740555.573666:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740555.573702:0:15045:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158313472 00000100:00100000:3.0:1790740555.573706:0:15045:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158313472 00000100:00100000:3.0:1790740555.573751:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790740555.573759:0:15045:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8498c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158313472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790740555.573785:0:15045:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790740555.573824:0:15045:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8498c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877727158313472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740555.573831:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790740555.573868:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1877727158313472:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1790740555.573898:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790740555.575848:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1877727158313344:0@lo:400:kworker.0 00000100:00100000:2.0:1790740555.575892:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740555.576188:0:15044:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158312960 00000100:00100000:0.0:1790740555.576196:0:15044:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158312960 00000100:00100000:3.0:1790740555.576256:0:15043:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158312832 00000100:00100000:3.0:1790740555.576262:0:15043:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158312832 00000100:00100000:3.0:1790740555.576306:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790740555.576314:0:15043:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0c86432d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1877727158312832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740555.576368:0:15043:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0c86432d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1877727158312832:12345-0@lo:400:kworker.0 Request processed in 54us (3009us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740555.576375:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790740555.576399:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790740555.576413:0:15044:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0c86431c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1877727158312960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740555.576451:0:15044:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0c86431c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1877727158312960:12345-0@lo:400:kworker.0 Request processed in 45us (3559us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740555.576507:0:14358:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158313344 00000100:00100000:1.0:1790740555.576512:0:14358:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158313344 00000100:00100000:2.0:1790740555.576871:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158312832:0@lo:400:kworker.0 00000100:00100000:2.0:1790740555.576887:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158312960:0@lo:400:kworker.0 00000100:00100000:1.0:1790740555.576918:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790740555.576925:0:14358:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0c86431180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877727158313344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790740555.576972:0:14358:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0c86431180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877727158313344:12345-0@lo:400:kworker.0 Request processed in 48us (1079us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740555.576978:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1790740555.578426:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790740555.578435:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790740555.581256:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1877727158313344:0@lo:400:kworker.0 00000100:00100000:0.0:1790740555.583422:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000001:00080000:0.0:1790740555.635429:0:5865:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934604 is committed 00000001:00080000:0.0:1790740555.635444:0:5865:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934597 is committed 00000001:00080000:0.0:1790740555.635544:0:5865:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:0.0:1790740555.635663:0:5865:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934605 is committed 00000001:00080000:0.0:1790740555.635675:0:5865:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:2.0:1790740555.899154:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740555.902906:0:14356:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133160960 00000100:00100000:1.0:1790740555.902979:0:14356:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133160960 00000100:00100000:1.0:1790740555.903189:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 33 00000100:00100000:1.0:1790740555.903201:0:14356:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0c86430700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:94f64522-bacd-439b-9eb0-785368ef5e14+11:14469:x1877727133160960:12345-192.168.203.58@tcp:101:cat.0 00010000:00010000:1.0:1790740555.903226:0:14356:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740555.903246:0:14356:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976a00/0xc6b31a1b598eb1b8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee916 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740555.903347:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976400/0xc6b31a1b598eb1bf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740555.903377:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976400/0xc6b31a1b598eb1bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740555.903388:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976400/0xc6b31a1b598eb1bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790740555.903399:0:14356:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1790740555.903609:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976a00/0xc6b31a1b598eb1b8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee916 expref: 14 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740555.903628:0:14356:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976400/0xc6b31a1b598eb1bf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee916 expref: 13 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740555.903637:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f0d84a1e200) 00010000:00010000:1.0:1790740555.903640:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790740555.903644:0:14356:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9f976400, rc 0) 00000100:00100000:1.0:1790740555.903712:0:14356:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0c86430700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:94f64522-bacd-439b-9eb0-785368ef5e14+13:14469:x1877727133160960:12345-192.168.203.58@tcp:101:cat.0 Request processed in 513us (4567us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1790740555.903719:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 33 00000100:00100000:3.0:1790740555.912999:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740555.913045:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740555.913074:0:14342:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133161344 00000100:00100000:3.0:1790740555.913082:0:14342:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133161344 00000100:00100000:3.0:1790740555.913134:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 1 00000100:00100000:3.0:1790740555.913143:0:14342:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8498e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:94f64522-bacd-439b-9eb0-785368ef5e14+13:2370:x1877727133161344:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790740555.913158:0:14342:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740555.913190:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976400/0xc6b31a1b598eb1bf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee916 expref: 13 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740555.913210:0:14342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f0d84a1e200) 00010000:00010000:3.0:1790740555.913214:0:14342:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790740555.913261:0:14342:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8498e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:94f64522-bacd-439b-9eb0-785368ef5e14+12:2370:x1877727133161344:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 120us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740555.913269:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 1 00000100:00100000:0.0:1790740555.914731:0:14360:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133161216 00000100:00100000:0.0:1790740555.914742:0:14360:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133161216 00000100:00100000:0.0:1790740555.914795:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 8 00000100:00100000:0.0:1790740555.914804:0:14360:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8498ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:94f64522-bacd-439b-9eb0-785368ef5e14+12:14469:x1877727133161216:12345-192.168.203.58@tcp:35:cat.0 00000100:00100000:0.0:1790740555.915148:0:14360:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8498ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:94f64522-bacd-439b-9eb0-785368ef5e14+13:14469:x1877727133161216:12345-192.168.203.58@tcp:35:cat.0 Request processed in 344us (2158us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1790740555.915155:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 8 00000100:00100000:3.0:1790740556.065775:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740556.065941:0:14358:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133161600 00000100:00100000:1.0:1790740556.065953:0:14358:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133161600 00000100:00100000:1.0:1790740556.066012:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 34 00000100:00100000:1.0:1790740556.066022:0:14358:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8498f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:94f64522-bacd-439b-9eb0-785368ef5e14+13:14475:x1877727133161600:12345-192.168.203.58@tcp:101:dd.0 00010000:00010000:1.0:1790740556.066055:0:14358:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740556.066076:0:14358:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976a00/0xc6b31a1b598eb1cd lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee91d expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740556.066206:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977400/0xc6b31a1b598eb1d4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740556.066223:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977400/0xc6b31a1b598eb1d4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740556.066237:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977400/0xc6b31a1b598eb1d4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790740556.066248:0:14358:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1790740556.066389:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976a00/0xc6b31a1b598eb1cd lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee91d expref: 16 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740556.066409:0:14358:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977400/0xc6b31a1b598eb1d4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee91d expref: 15 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740556.066428:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f0d84a1e200) 00010000:00010000:1.0:1790740556.066431:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790740556.066434:0:14358:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9f977400, rc 0) 00000100:00100000:1.0:1790740556.066495:0:14358:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8498f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:94f64522-bacd-439b-9eb0-785368ef5e14+15:14475:x1877727133161600:12345-192.168.203.58@tcp:101:dd.0 Request processed in 474us (730us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1790740556.066503:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 34 00000100:00100000:0.0:1790740556.073443:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740556.073651:0:16583:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133161856 00000100:00100000:2.0:1790740556.073661:0:16583:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133161856 00000100:00100000:2.0:1790740556.073723:0:16583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 35 00000100:00100000:2.0:1790740556.073733:0:16583:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd86df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:94f64522-bacd-439b-9eb0-785368ef5e14+15:14475:x1877727133161856:12345-192.168.203.58@tcp:36:dd.0 00010000:00010000:2.0:1790740556.073787:0:16583:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1790740556.073811:0:16583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977400/0xc6b31a1b598eb1d4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee91d expref: 15 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740556.073848:0:16583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ee00/0xc6b31a1b598eb187 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee901 expref: 14 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740556.073859:0:16583:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f0d84a1e200) 00010000:00010000:2.0:1790740556.073864:0:16583:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790740556.074063:0:16583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0ca00/0xc6b31a1b598eb1e2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740556.074077:0:16583:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0ca00/0xc6b31a1b598eb1e2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740556.074087:0:16583:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0ca00/0xc6b31a1b598eb1e2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790740556.074135:0:16583:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1790740556.074197:0:16583:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000720c0a26 reply state 0000000079674a8a transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0ca00/0xc6b31a1b598eb1e2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740556.074206:0:16583:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790740556.074299:0:16583:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd86df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:94f64522-bacd-439b-9eb0-785368ef5e14+16:14475:x1877727133161856:12345-192.168.203.58@tcp:36:dd.0 Request processed in 568us (864us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1790740556.074307:0:16583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 35 00000020:00080000:2.0:1790740556.074312:0:16583:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790740556.078875:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0ca00/0xc6b31a1b598eb1e2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740556.078892:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0ca00/0xc6b31a1b598eb1e2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740556.078899:0:3290:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0ca00/0xc6b31a1b598eb1e2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740556.078905:0:3290:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0c84d0ca00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1790740556.078910:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0ca00/0xc6b31a1b598eb1e2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740556.078933:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0ca00/0xc6b31a1b598eb1e2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740556.078951:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f0d84a1e200) 00010000:00010000:0.0:1790740556.078954:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740556.078958:0:3290:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0ca00/0xc6b31a1b598eb1e2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740556.078964:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0ca00/0xc6b31a1b598eb1e2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740556.080923:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740556.150260:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740556.150350:0:14360:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133162112 00000100:00100000:2.0:1790740556.150359:0:14360:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133162112 00000100:00100000:2.0:1790740556.150444:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 9 00000100:00100000:2.0:1790740556.150461:0:14360:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd86ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:94f64522-bacd-439b-9eb0-785368ef5e14+15:14475:x1877727133162112:12345-192.168.203.58@tcp:35:dd.0 00000100:00100000:2.0:1790740556.150716:0:14360:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd86ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:94f64522-bacd-439b-9eb0-785368ef5e14+16:14475:x1877727133162112:12345-192.168.203.58@tcp:35:dd.0 Request processed in 264us (464us total) trans 8589934611 rc 0/0 00000100:00100000:2.0:1790740556.151370:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 9 00000100:00100000:2.0:1790740556.463185:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740556.463835:0:14358:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133162240 00000100:00100000:1.0:1790740556.463846:0:14358:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133162240 00000100:00100000:1.0:1790740556.463906:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 36 00000100:00100000:1.0:1790740556.463916:0:14358:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0c86433b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:94f64522-bacd-439b-9eb0-785368ef5e14+16:14489:x1877727133162240:12345-192.168.203.58@tcp:101:stat.0 00010000:00010000:1.0:1790740556.463957:0:14358:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740556.463978:0:14358:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976a00/0xc6b31a1b598eb1e9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee924 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740556.464046:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598eb1f0 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740556.464061:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598eb1f0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740556.464082:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598eb1f0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740556.464097:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598eb1f7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740556.464105:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598eb1f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740556.464111:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598eb1f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740556.464385:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977c00/0xc6b31a1b598eb1fe lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740556.464395:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977c00/0xc6b31a1b598eb1fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740556.464402:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977c00/0xc6b31a1b598eb1fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790740556.464439:0:14358:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1790740556.464448:0:14358:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790740556.464486:0:14358:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977c00/0xc6b31a1b598eb1fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740556.464498:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977c00/0xc6b31a1b598eb1fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740556.464506:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598eb1f0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740556.464527:0:14358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598eb1f0 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740556.464534:0:14358:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598eb1f0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740556.464540:0:14358:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f976000 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1790740556.464543:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598eb1f0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740556.464550:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598eb1f0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740556.464567:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f0d98cd3000) 00010000:00010000:1.0:1790740556.464987:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740556.464995:0:14358:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598eb1f0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740556.465003:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976000/0xc6b31a1b598eb1f0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740556.465017:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598eb1f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740556.465035:0:14358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598eb1f7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740556.465042:0:14358:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598eb1f7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740556.465048:0:14358:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9f977000 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1790740556.465052:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598eb1f7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740556.465058:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598eb1f7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740556.465067:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8f0d84a1ed00) 00010000:00010000:1.0:1790740556.465334:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740556.465339:0:14358:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598eb1f7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740556.465346:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598eb1f7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740556.465388:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976a00/0xc6b31a1b598eb1e9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee924 expref: 18 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740556.465401:0:14358:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977c00/0xc6b31a1b598eb1fe lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee924 expref: 17 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740556.465409:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f0d84a1e200) 00010000:00010000:1.0:1790740556.465411:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790740556.465421:0:14358:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9f977c00, rc 0) 00000100:00100000:1.0:1790740556.465492:0:14358:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0c86433b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:94f64522-bacd-439b-9eb0-785368ef5e14+17:14489:x1877727133162240:12345-192.168.203.58@tcp:101:stat.0 Request processed in 1576us (2322us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740556.465501:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 36 00000100:00100000:3.0:1790740556.573214:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740556.573385:0:16583:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133162496 00000100:00100000:2.0:1790740556.573395:0:16583:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133162496 00000100:00100000:2.0:1790740556.573453:0:16583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 37 00000100:00100000:2.0:1790740556.573462:0:16583:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8498e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:94f64522-bacd-439b-9eb0-785368ef5e14+17:14495:x1877727133162496:12345-192.168.203.58@tcp:36:truncate.0 00010000:00010000:2.0:1790740556.573516:0:16583:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740556.573541:0:16583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977c00/0xc6b31a1b598eb1fe lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee924 expref: 17 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740556.573560:0:16583:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f0d84a1e200) 00010000:00010000:2.0:1790740556.573565:0:16583:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790740556.573828:0:16583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0d200/0xc6b31a1b598eb205 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740556.573842:0:16583:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0d200/0xc6b31a1b598eb205 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740556.573851:0:16583:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0d200/0xc6b31a1b598eb205 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790740556.573896:0:16583:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:2.0:1790740556.573918:0:16583:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ef2cc6c6 reply state 000000009fa05b6e transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0d200/0xc6b31a1b598eb205 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740556.573926:0:16583:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790740556.574340:0:16583:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8498e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:94f64522-bacd-439b-9eb0-785368ef5e14+19:14495:x1877727133162496:12345-192.168.203.58@tcp:36:truncate.0 Request processed in 877us (1135us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1790740556.574348:0:16583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 37 00000020:00080000:2.0:1790740556.574361:0:16583:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790740556.579771:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0d200/0xc6b31a1b598eb205 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740556.579788:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0d200/0xc6b31a1b598eb205 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740556.579796:0:3289:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0d200/0xc6b31a1b598eb205 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740556.579803:0:3289:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0c84d0d200 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740556.579808:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0d200/0xc6b31a1b598eb205 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740556.579816:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0d200/0xc6b31a1b598eb205 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740556.579831:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f0d84a1e200) 00010000:00010000:2.0:1790740556.579835:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740556.579839:0:3289:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0d200/0xc6b31a1b598eb205 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740556.579844:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0d200/0xc6b31a1b598eb205 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740556.798811:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740556.798892:0:14357:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133162624 00000100:00100000:0.0:1790740556.798903:0:14357:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133162624 00000100:00100000:0.0:1790740556.799083:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 38 00000100:00100000:0.0:1790740556.799095:0:14357:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8498ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:94f64522-bacd-439b-9eb0-785368ef5e14+18:14509:x1877727133162624:12345-192.168.203.58@tcp:101:stat.0 00010000:00010000:0.0:1790740556.799120:0:14357:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740556.799140:0:14357:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e000/0xc6b31a1b598eb20c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee92b expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740556.799214:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598eb213 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740556.799229:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598eb213 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740556.799239:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598eb213 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740556.799835:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598eb21a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740556.799860:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598eb21a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740556.799867:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598eb21a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740556.800395:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f400/0xc6b31a1b598eb221 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740556.800405:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f400/0xc6b31a1b598eb221 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740556.800413:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f400/0xc6b31a1b598eb221 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790740556.800449:0:14357:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:0.0:1790740556.800454:0:14357:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790740556.800477:0:14357:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f400/0xc6b31a1b598eb221 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740556.800487:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f400/0xc6b31a1b598eb221 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740556.800496:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598eb213 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740556.800502:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598eb213 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740556.800509:0:14357:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598eb213 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740556.800525:0:14357:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132ee00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1790740556.800529:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598eb213 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740556.800537:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598eb213 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740556.800550:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f0d98cd3000) 00010000:00010000:0.0:1790740556.800553:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740556.800558:0:14357:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598eb213 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740556.800565:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598eb213 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740556.800784:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598eb21a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740556.800790:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598eb21a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740556.800796:0:14357:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598eb21a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740556.800802:0:14357:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132e600 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1790740556.800805:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598eb21a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740556.800811:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598eb21a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740556.800830:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8f0d84bf8300) 00010000:00010000:0.0:1790740556.800833:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740556.800836:0:14357:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598eb21a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740556.800842:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598eb21a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740556.800877:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e000/0xc6b31a1b598eb20c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee92b expref: 20 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740556.800889:0:14357:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f400/0xc6b31a1b598eb221 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee92b expref: 19 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740556.800896:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f0d84a1e200) 00010000:00010000:0.0:1790740556.800898:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790740556.800900:0:14357:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0dc132f400, rc 0) 00000100:00100000:0.0:1790740556.801083:0:14357:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8498ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:94f64522-bacd-439b-9eb0-785368ef5e14+19:14509:x1877727133162624:12345-192.168.203.58@tcp:101:stat.0 Request processed in 1981us (2280us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740556.801092:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 38 00000100:00100000:0.0:1790740556.940353:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740556.940443:0:16583:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133162880 00000100:00100000:2.0:1790740556.940452:0:16583:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133162880 00000100:00100000:2.0:1790740556.940511:0:16583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 39 00000100:00100000:2.0:1790740556.940521:0:16583:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd86dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:94f64522-bacd-439b-9eb0-785368ef5e14+19:14519:x1877727133162880:12345-192.168.203.58@tcp:101:lfs.0 00010000:00010000:2.0:1790740556.940541:0:16583:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740556.940560:0:16583:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0d200/0xc6b31a1b598eb228 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee932 expref: -99 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740556.940728:0:16583:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1790740556.940834:0:16583:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0d200/0xc6b31a1b598eb228 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee932 expref: 21 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740556.940849:0:16583:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0d84bf8d00) 00010000:00010000:2.0:1790740556.940852:0:16583:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790740556.940858:0:16583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0d200/0xc6b31a1b598eb228 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee932 expref: 21 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740556.940872:0:16583:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0c84d0d200, rc 0) 00000100:00100000:2.0:1790740556.940932:0:16583:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd86dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:94f64522-bacd-439b-9eb0-785368ef5e14+20:14519:x1877727133162880:12345-192.168.203.58@tcp:101:lfs.0 Request processed in 412us (587us total) trans 8589934614 rc 301/301 00000100:00100000:2.0:1790740556.940939:0:16583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 39 00000100:00100000:3.0:1790740556.950143:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740556.951234:0:14359:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133163136 00000100:00100000:0.0:1790740556.951245:0:14359:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133163136 00000100:00100000:0.0:1790740556.951311:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 10 00000100:00100000:0.0:1790740556.951322:0:14359:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d848be050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:94f64522-bacd-439b-9eb0-785368ef5e14+20:14519:x1877727133163136:12345-192.168.203.58@tcp:35:lfs.0 00000100:00100000:0.0:1790740556.951801:0:14359:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d848be050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:94f64522-bacd-439b-9eb0-785368ef5e14+21:14519:x1877727133163136:12345-192.168.203.58@tcp:35:lfs.0 Request processed in 475us (1661us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1790740556.951828:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 10 00000100:00100000:3.0:1790740557.053357:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740557.053471:0:14358:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133163392 00000100:00100000:1.0:1790740557.053481:0:14358:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133163392 00000100:00100000:1.0:1790740557.053550:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 40 00000100:00100000:1.0:1790740557.053561:0:14358:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8498f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:94f64522-bacd-439b-9eb0-785368ef5e14+21:14525:x1877727133163392:12345-192.168.203.58@tcp:101:bash.0 00010000:00010000:1.0:1790740557.053617:0:14358:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740557.053638:0:14358:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976a00/0xc6b31a1b598eb236 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee939 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740557.053775:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598eb23d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740557.053789:0:14358:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598eb172 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee8fa expref: 22 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740557.053797:0:14358:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f400/0xc6b31a1b598eb221 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee92b expref: 22 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740557.053804:0:14358:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598eb23d lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740557.053839:0:14358:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f400/0xc6b31a1b598eb221 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee92b expref: 22 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740557.053864:0:14358:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f400/0xc6b31a1b598eb221 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee92b expref: 22 pid: 14357 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740557.053892:0:14358:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda73800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14358:1877727158313600:192.168.203.58@tcp:104: 00010000:00010000:1.0:1790740557.054001:0:14358:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598eb172 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee8fa expref: 22 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740557.054011:0:14358:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598eb172 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee8fa expref: 22 pid: 16583 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740557.054020:0:14358:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda73100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14358:1877727158313728:192.168.203.58@tcp:104: 00000100:00100000:1.0:1790740557.054044:0:14358:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d98019a80 going to sleep for 11 seconds 00000100:00080000:3.0:1790740557.054281:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790740557.060782:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740557.060899:0:14358:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda73800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14358:1877727158313600:192.168.203.58@tcp:104: 00000100:00100000:1.0:1790740557.060912:0:14358:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda73100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14358:1877727158313728:192.168.203.58@tcp:104: 00010000:00010000:1.0:1790740557.060943:0:14358:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598eb23d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740557.060971:0:14343:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133163520 00000100:00100000:0.0:1790740557.060978:0:14343:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133163520 00010000:00010000:0.0:1790740557.061011:0:14343:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f400/0xc6b31a1b598eb221 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee92b expref: 23 pid: 14357 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740557.061044:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 11 00000100:00100000:0.0:1790740557.061053:0:14343:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd8f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:94f64522-bacd-439b-9eb0-785368ef5e14+23:2369:x1877727133163520:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790740557.061066:0:14343:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740557.061086:0:14343:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f400/0xc6b31a1b598eb221 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee92b expref: 23 pid: 14357 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.061096:0:14343:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f400/0xc6b31a1b598eb221 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee92b expref: 23 pid: 14357 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.061117:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f400/0xc6b31a1b598eb221 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee92b expref: 23 pid: 14357 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.061131:0:14343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f0d84a1e200) 00010000:00010000:0.0:1790740557.061136:0:14343:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598eb23d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.061145:0:14343:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598eb23d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.061150:0:14343:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740557.061217:0:14343:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd8f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:94f64522-bacd-439b-9eb0-785368ef5e14+22:2369:x1877727133163520:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 165us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740557.061237:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 11 00000100:00100000:2.0:1790740557.072046:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740557.072191:0:14341:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133163648 00000100:00100000:0.0:1790740557.072201:0:14341:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133163648 00010000:00010000:0.0:1790740557.072242:0:14341:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598eb172 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee8fa expref: 22 pid: 16583 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740557.072280:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 12 00000100:00100000:0.0:1790740557.072288:0:14341:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0c86430e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:94f64522-bacd-439b-9eb0-785368ef5e14+22:2370:x1877727133163648:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790740557.072304:0:14341:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740557.072311:0:14341:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598eb172 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee8fa expref: 22 pid: 16583 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.072337:0:14341:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598eb172 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee8fa expref: 22 pid: 16583 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.072357:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598eb172 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee8fa expref: 22 pid: 16583 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.072375:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f0d84a1e200) 00010000:00010000:0.0:1790740557.072381:0:14341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598eb23d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.072391:0:14341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598eb23d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.072398:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598eb23d lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.072448:0:14341:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740557.072496:0:14341:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0c86430e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:94f64522-bacd-439b-9eb0-785368ef5e14+21:2370:x1877727133163648:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 208us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740557.072503:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 12 00010000:00010000:1.0:1790740557.072523:0:14358:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598eb23d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740557.072532:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598eb23d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790740557.072551:0:14358:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:1.0:1790740557.072734:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976a00/0xc6b31a1b598eb236 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee939 expref: 22 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740557.072749:0:14358:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598eb23d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee939 expref: 21 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740557.072762:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f0d84a1e200) 00010000:00010000:1.0:1790740557.072765:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790740557.072767:0:14358:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9f977000, rc 0) 00000100:00100000:1.0:1790740557.072791:0:14358:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8498f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:94f64522-bacd-439b-9eb0-785368ef5e14+21:14525:x1877727133163392:12345-192.168.203.58@tcp:101:bash.0 Request processed in 19233us (19443us total) trans 8589934616 rc 0/0 00000100:00100000:1.0:1790740557.072801:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 40 00000100:00100000:1.0:1790740557.076415:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740557.076507:0:16583:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133163904 00000100:00100000:2.0:1790740557.076517:0:16583:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133163904 00000100:00100000:2.0:1790740557.076607:0:16583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 41 00000100:00100000:2.0:1790740557.076617:0:16583:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:94f64522-bacd-439b-9eb0-785368ef5e14+21:14525:x1877727133163904:12345-192.168.203.58@tcp:36:bash.0 00010000:00010000:2.0:1790740557.076869:0:16583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0cc00/0xc6b31a1b598eb24b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.076886:0:16583:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0cc00/0xc6b31a1b598eb24b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.076897:0:16583:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0cc00/0xc6b31a1b598eb24b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790740557.076968:0:16583:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:2.0:1790740557.076993:0:16583:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000005a98bd60 reply state 00000000adf48f4a transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0cc00/0xc6b31a1b598eb24b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740557.077002:0:16583:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790740557.077081:0:16583:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:94f64522-bacd-439b-9eb0-785368ef5e14+24:14525:x1877727133163904:12345-192.168.203.58@tcp:36:bash.0 Request processed in 465us (675us total) trans 8589934618 rc 0/0 00000100:00100000:2.0:1790740557.077089:0:16583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 41 00000020:00080000:2.0:1790740557.077094:0:16583:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790740557.078521:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0cc00/0xc6b31a1b598eb24b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.078534:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0cc00/0xc6b31a1b598eb24b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.078540:0:3290:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0cc00/0xc6b31a1b598eb24b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.078546:0:3290:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0c84d0cc00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1790740557.078550:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0cc00/0xc6b31a1b598eb24b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.078557:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0cc00/0xc6b31a1b598eb24b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.078605:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f0d84a1e200) 00010000:00010000:0.0:1790740557.078609:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740557.078614:0:3290:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0cc00/0xc6b31a1b598eb24b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.078620:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0cc00/0xc6b31a1b598eb24b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740557.079254:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740557.079313:0:14357:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133164032 00000100:00100000:0.0:1790740557.079327:0:14357:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133164032 00000100:00100000:0.0:1790740557.079390:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 42 00000100:00100000:0.0:1790740557.079399:0:14357:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:94f64522-bacd-439b-9eb0-785368ef5e14+23:14525:x1877727133164032:12345-192.168.203.58@tcp:101:bash.0 00010000:00010000:0.0:1790740557.079421:0:14357:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740557.079435:0:14357:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e000/0xc6b31a1b598eb252 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee940 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.079484:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e000/0xc6b31a1b598eb252 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee940 expref: 24 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.079497:0:14357:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e000/0xc6b31a1b598eb252 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee940 expref: 24 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.079513:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f0d84a1e200) 00010000:00010000:0.0:1790740557.079515:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790740557.079518:0:14357:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0dc132e000, rc 0) 00000100:00100000:0.0:1790740557.079604:0:14357:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:94f64522-bacd-439b-9eb0-785368ef5e14+24:14525:x1877727133164032:12345-192.168.203.58@tcp:101:bash.0 Request processed in 168us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740557.079611:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 42 00000100:00100000:3.0:1790740557.086869:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740557.087121:0:16583:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133164160 00000100:00100000:2.0:1790740557.087130:0:16583:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133164160 00000100:00100000:2.0:1790740557.087189:0:16583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 43 00000100:00100000:2.0:1790740557.087199:0:16583:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8498df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:94f64522-bacd-439b-9eb0-785368ef5e14+24:14525:x1877727133164160:12345-192.168.203.58@tcp:101:bash.0 00010000:00010000:2.0:1790740557.087217:0:16583:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740557.087237:0:16583:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0d600/0xc6b31a1b598eb259 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee947 expref: -99 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.087323:0:16583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0d800/0xc6b31a1b598eb260 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.087337:0:16583:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598eb23d lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee939 expref: 25 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.087345:0:16583:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0d800/0xc6b31a1b598eb260 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.087377:0:16583:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598eb23d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee939 expref: 25 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.087406:0:16583:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598eb23d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee939 expref: 25 pid: 14358 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740557.087419:0:16583:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0c86431f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16583:1877727158313856:192.168.203.58@tcp:104: 00000100:00100000:2.0:1790740557.087514:0:16583:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0dbda3d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790740557.091102:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740557.091237:0:14342:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133164288 00000100:00100000:0.0:1790740557.091246:0:14342:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133164288 00010000:00010000:0.0:1790740557.091284:0:14342:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598eb23d lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee939 expref: 26 pid: 14358 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740557.091327:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 13 00000100:00100000:0.0:1790740557.091337:0:14342:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8498ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:94f64522-bacd-439b-9eb0-785368ef5e14+26:2369:x1877727133164288:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790740557.091351:0:14342:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790740557.091357:0:14342:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598eb23d lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee939 expref: 26 pid: 14358 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.091382:0:14342:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598eb23d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee939 expref: 26 pid: 14358 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.091402:0:14342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f0d84a1e200) 00010000:00010000:0.0:1790740557.091407:0:14342:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0d800/0xc6b31a1b598eb260 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.091417:0:14342:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0d800/0xc6b31a1b598eb260 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.091424:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0d800/0xc6b31a1b598eb260 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.091442:0:14342:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790740557.091492:0:14342:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8498ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:94f64522-bacd-439b-9eb0-785368ef5e14+26:2369:x1877727133164288:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 156us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740557.091499:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 13 00010000:00010000:2.0:1790740557.092516:0:16583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598eb23d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee939 expref: 25 pid: 14358 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740557.092536:0:16583:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0c86431f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16583:1877727158313856:192.168.203.58@tcp:104: 00010000:00010000:2.0:1790740557.092555:0:16583:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0d800/0xc6b31a1b598eb260 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.092565:0:16583:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0d800/0xc6b31a1b598eb260 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.092619:0:16583:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0d800/0xc6b31a1b598eb260 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740557.092665:0:16583:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1790740557.092669:0:16583:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790740557.092689:0:16583:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0d800/0xc6b31a1b598eb260 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.092730:0:16583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0d600/0xc6b31a1b598eb259 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee947 expref: 25 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.092746:0:16583:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0d800/0xc6b31a1b598eb260 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee947 expref: 24 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.092767:0:16583:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f0d84a1e200) 00010000:00010000:2.0:1790740557.092771:0:16583:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790740557.092773:0:16583:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0c84d0d800, rc 0) 00000100:00100000:2.0:1790740557.092860:0:16583:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8498df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:94f64522-bacd-439b-9eb0-785368ef5e14+24:14525:x1877727133164160:12345-192.168.203.58@tcp:101:bash.0 Request processed in 5662us (5998us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740557.092869:0:16583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 43 00000100:00100000:3.0:1790740557.097330:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740557.097398:0:14343:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133164544 00000100:00100000:1.0:1790740557.097408:0:14343:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133164544 00000100:00100000:1.0:1790740557.097467:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 2 00000100:00100000:1.0:1790740557.097476:0:14343:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8498d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:94f64522-bacd-439b-9eb0-785368ef5e14+24:14525:x1877727133164544:12345-192.168.203.58@tcp:103:bash.0 00010000:00010000:1.0:1790740557.097490:0:14343:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1790740557.097513:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0d800/0xc6b31a1b598eb260 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee947 expref: 24 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740557.097532:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e000/0xc6b31a1b598eb252 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee940 expref: 23 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740557.097542:0:14343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f0d84a1e200) 00010000:00010000:1.0:1790740557.097552:0:14343:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790740557.097839:0:14343:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8498d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:94f64522-bacd-439b-9eb0-785368ef5e14+22:14525:x1877727133164544:12345-192.168.203.58@tcp:103:bash.0 Request processed in 363us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740557.097848:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 2 00000100:00100000:3.0:1790740557.100419:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740557.100603:0:14357:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133164672 00000100:00100000:0.0:1790740557.100613:0:14357:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133164672 00000100:00100000:0.0:1790740557.100664:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 44 00000100:00100000:0.0:1790740557.100672:0:14357:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8498d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:94f64522-bacd-439b-9eb0-785368ef5e14+22:14525:x1877727133164672:12345-192.168.203.58@tcp:58:bash.0 00010000:00010000:0.0:1790740557.100790:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598eb267 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.100805:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598eb267 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.100816:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598eb267 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790740557.101486:0:14357:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790740557.101669:0:14357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1790740557.101736:0:14357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1790740557.101831:0:14357:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8498d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:94f64522-bacd-439b-9eb0-785368ef5e14+22:14525:x1877727133164672:12345-192.168.203.58@tcp:58:bash.0 Request processed in 1157us (1416us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740557.101841:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 44 00010000:00010000:2.0:1790740557.105952:0:15644:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740557.109817:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740557.110085:0:14356:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133164800 00000100:00100000:1.0:1790740557.110108:0:14356:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133164800 00000100:00100000:1.0:1790740557.110200:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 45 00000100:00100000:1.0:1790740557.110211:0:14356:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd86ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:94f64522-bacd-439b-9eb0-785368ef5e14+22:14525:x1877727133164800:12345-192.168.203.58@tcp:101:bash.0 00010000:00010000:1.0:1790740557.110231:0:14356:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740557.110250:0:14356:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976a00/0xc6b31a1b598eb26e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee94e expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740557.110309:0:14356:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598eb267 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740557.110320:0:14356:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976a00/0xc6b31a1b598eb26e lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee94e expref: 23 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740557.110338:0:14356:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598eb267 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740557.110350:0:14356:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976a00/0xc6b31a1b598eb26e lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee94e expref: 23 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740557.110363:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f0d84bf8300) 00010000:00010000:1.0:1790740557.110367:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790740557.110370:0:14356:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976a00/0xc6b31a1b598eb26e lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee94e expref: 23 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740557.110378:0:14356:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9f976a00, rc 0) 00000100:00100000:1.0:1790740557.110435:0:14356:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd86ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:94f64522-bacd-439b-9eb0-785368ef5e14+23:14525:x1877727133164800:12345-192.168.203.58@tcp:101:bash.0 Request processed in 226us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740557.110441:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 45 00000040:00080000:0.0:1790740557.488861:0:14391:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1790740557.488871:0:14391:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790740557.488925:0:14391:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1790740557.488934:0:14391:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1790740557.489063:0:14391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd86d500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14391:1877727158313984:192.168.203.58@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790740557.489188:0:14391:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0db6f3b240 going to sleep for 11 seconds 00000100:00100000:0.0:1790740557.494243:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740557.494351:0:14391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd86d500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14391:1877727158313984:192.168.203.58@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790740557.494685:0:14367:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133164928 00000100:00100000:2.0:1790740557.494693:0:14367:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133164928 00000100:00100000:2.0:1790740557.494741:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 0 00000100:00100000:2.0:1790740557.494749:0:14367:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd86f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:94f64522-bacd-439b-9eb0-785368ef5e14+23:14526:x1877727133164928:12345-192.168.203.58@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1790740557.494830:0:14367:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd86f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:94f64522-bacd-439b-9eb0-785368ef5e14+23:14526:x1877727133164928:12345-192.168.203.58@tcp:900:lhsmtool_posix.0 Request processed in 82us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740557.494839:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 0 00000100:00100000:2.0:1790740557.501773:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740557.503146:0:14357:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133165056 00000100:00100000:0.0:1790740557.503168:0:14357:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133165056 00000100:00100000:0.0:1790740557.503231:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 46 00000100:00100000:0.0:1790740557.503247:0:14357:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0c86431f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:94f64522-bacd-439b-9eb0-785368ef5e14+23:14526:x1877727133165056:12345-192.168.203.58@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790740557.503278:0:14357:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790740557.503415:0:14357:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0c86431f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:94f64522-bacd-439b-9eb0-785368ef5e14+23:14526:x1877727133165056:12345-192.168.203.58@tcp:53:lhsmtool_posix.0 Request processed in 175us (1650us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740557.503422:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 46 00000100:00100000:3.0:1790740557.515611:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740557.515696:0:16583:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133165184 00000100:00100000:2.0:1790740557.515707:0:16583:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133165184 00000100:00100000:2.0:1790740557.515765:0:16583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 47 00000100:00100000:2.0:1790740557.515774:0:16583:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8498c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:94f64522-bacd-439b-9eb0-785368ef5e14+23:14526:x1877727133165184:12345-192.168.203.58@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1790740557.516810:0:16583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0d000/0xc6b31a1b598eb275 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.516830:0:16583:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0d000/0xc6b31a1b598eb275 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.516842:0:16583:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0d000/0xc6b31a1b598eb275 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.516985:0:16583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0de00/0xc6b31a1b598eb27c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.516994:0:16583:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0de00/0xc6b31a1b598eb27c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.517001:0:16583:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0de00/0xc6b31a1b598eb27c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.517025:0:16583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0da00/0xc6b31a1b598eb283 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.517033:0:16583:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0da00/0xc6b31a1b598eb283 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.517039:0:16583:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0da00/0xc6b31a1b598eb283 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790740557.517079:0:16583:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1790740557.517083:0:16583:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790740557.517096:0:16583:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0da00/0xc6b31a1b598eb283 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.517117:0:16583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0d000/0xc6b31a1b598eb275 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.517124:0:16583:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0d000/0xc6b31a1b598eb275 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.517131:0:16583:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0d000/0xc6b31a1b598eb275 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.517149:0:16583:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0c84d0d000 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740557.517153:0:16583:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0d000/0xc6b31a1b598eb275 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.517171:0:16583:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0d000/0xc6b31a1b598eb275 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.517183:0:16583:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f0d98cd3c00) 00010000:00010000:2.0:1790740557.517186:0:16583:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740557.517191:0:16583:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0d000/0xc6b31a1b598eb275 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.517197:0:16583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0d000/0xc6b31a1b598eb275 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.517210:0:16583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0de00/0xc6b31a1b598eb27c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.517216:0:16583:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0de00/0xc6b31a1b598eb27c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.517221:0:16583:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0de00/0xc6b31a1b598eb27c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.517226:0:16583:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0c84d0de00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740557.517228:0:16583:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0de00/0xc6b31a1b598eb27c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.517234:0:16583:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0de00/0xc6b31a1b598eb27c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.520006:0:16583:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8f0d98cd3b00) 00010000:00010000:2.0:1790740557.520010:0:16583:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740557.520031:0:16583:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0de00/0xc6b31a1b598eb27c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.520040:0:16583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0de00/0xc6b31a1b598eb27c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.520075:0:16583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0da00/0xc6b31a1b598eb283 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.520083:0:16583:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0da00/0xc6b31a1b598eb283 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.520090:0:16583:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0da00/0xc6b31a1b598eb283 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.520096:0:16583:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0c84d0da00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740557.520108:0:16583:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0da00/0xc6b31a1b598eb283 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.520116:0:16583:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0da00/0xc6b31a1b598eb283 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.520124:0:16583:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f0d84bf8300) 00010000:00010000:2.0:1790740557.520126:0:16583:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740557.520130:0:16583:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0da00/0xc6b31a1b598eb283 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.520135:0:16583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0da00/0xc6b31a1b598eb283 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740557.520262:0:16583:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8498c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:94f64522-bacd-439b-9eb0-785368ef5e14+23:14526:x1877727133165184:12345-192.168.203.58@tcp:34:lhsmtool_posix.0 Request processed in 4485us (4658us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740557.520272:0:16583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 47 00000100:00100000:3.0:1790740557.531761:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740557.531870:0:14357:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133165440 00000100:00100000:0.0:1790740557.531880:0:14357:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133165440 00000100:00100000:0.0:1790740557.531940:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 48 00000100:00100000:0.0:1790740557.531952:0:14357:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8498dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:94f64522-bacd-439b-9eb0-785368ef5e14+23:14526:x1877727133165440:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790740557.531986:0:14357:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740557.532006:0:14357:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598eb28a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee955 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.532114:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e000/0xc6b31a1b598eb291 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.532129:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e000/0xc6b31a1b598eb291 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.532140:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e000/0xc6b31a1b598eb291 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790740557.532151:0:14357:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1790740557.532261:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e000/0xc6b31a1b598eb291 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.532269:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e000/0xc6b31a1b598eb291 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.532275:0:14357:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e000/0xc6b31a1b598eb291 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.532280:0:14357:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132e000 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1790740557.532285:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e000/0xc6b31a1b598eb291 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.532292:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e000/0xc6b31a1b598eb291 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.532303:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f0d84bf8300) 00010000:00010000:0.0:1790740557.532312:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790740557.532317:0:14357:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e000/0xc6b31a1b598eb291 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.532322:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e000/0xc6b31a1b598eb291 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.532375:0:14357:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598eb28a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee955 expref: 25 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.532385:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f0d98cd3c00) 00010000:00010000:0.0:1790740557.532388:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790740557.532392:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598eb28a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee955 expref: 25 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.532401:0:14357:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0dc132ee00, rc 0) 00000100:00100000:0.0:1790740557.532464:0:14357:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8498dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:94f64522-bacd-439b-9eb0-785368ef5e14+24:14526:x1877727133165440:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 Request processed in 514us (713us total) trans 8589934619 rc 301/301 00000100:00100000:0.0:1790740557.532472:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 48 00000100:00100000:3.0:1790740557.545781:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740557.546086:0:14356:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133165568 00000100:00100000:1.0:1790740557.546095:0:14356:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133165568 00000100:00100000:1.0:1790740557.546155:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 49 00000100:00100000:1.0:1790740557.546174:0:14356:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8498f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:94f64522-bacd-439b-9eb0-785368ef5e14+24:14526:x1877727133165568:12345-192.168.203.58@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790740557.546208:0:14356:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790740557.546511:0:14356:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8498f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:94f64522-bacd-439b-9eb0-785368ef5e14+24:14526:x1877727133165568:12345-192.168.203.58@tcp:53:lhsmtool_posix.0 Request processed in 338us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740557.546519:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 49 00000100:00100000:3.0:1790740557.551115:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740557.561885:0:14358:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133165824 00000100:00100000:1.0:1790740557.561899:0:14358:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133165824 00000100:00100000:1.0:1790740557.562027:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 50 00000100:00100000:1.0:1790740557.562038:0:14358:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8498fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:94f64522-bacd-439b-9eb0-785368ef5e14+24:14526:x1877727133165824:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790740557.562058:0:14358:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740557.562078:0:14358:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598eb29f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee95c expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790740557.562835:0:14358:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =28 00000004:00080000:1.0:1790740557.562843:0:14358:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+28 in llog 00000004:00080000:1.0:1790740557.562889:0:14358:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:1.0:1790740557.563145:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598eb2a6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740557.563168:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598eb2a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740557.563181:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598eb2a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740557.563254:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f977000/0xc6b31a1b598eb29f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee95c expref: 27 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740557.563272:0:14358:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598eb2a6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee95c expref: 26 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740557.563280:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f0d84a1e200) 00010000:00010000:1.0:1790740557.563283:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790740557.563286:0:14358:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9f976600, rc 0) 00000100:00100000:1.0:1790740557.563359:0:14358:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8498fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:94f64522-bacd-439b-9eb0-785368ef5e14+26:14526:x1877727133165824:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 Request processed in 1323us (12784us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1790740557.563368:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 50 00000100:00100000:3.0:1790740557.574428:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740557.574521:0:16583:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133166080 00000100:00100000:2.0:1790740557.574530:0:16583:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133166080 00000100:00100000:2.0:1790740557.574608:0:16583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 51 00000100:00100000:2.0:1790740557.574618:0:16583:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8498ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:94f64522-bacd-439b-9eb0-785368ef5e14+26:14526:x1877727133166080:12345-192.168.203.58@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790740557.574671:0:16583:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740557.574706:0:16583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976600/0xc6b31a1b598eb2a6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee95c expref: 26 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.574725:0:16583:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f0d84a1e200) 00010000:00010000:2.0:1790740557.574736:0:16583:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790740557.574758:0:16583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0da00/0xc6b31a1b598eb2b4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.574772:0:16583:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0da00/0xc6b31a1b598eb2b4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.574782:0:16583:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0da00/0xc6b31a1b598eb2b4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.574796:0:16583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0de00/0xc6b31a1b598eb2bb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd9fec560 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.574803:0:16583:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0de00/0xc6b31a1b598eb2bb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd9fec560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.574810:0:16583:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0de00/0xc6b31a1b598eb2bb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd9fec560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.575002:0:16583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0da00/0xc6b31a1b598eb2b4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.575010:0:16583:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0da00/0xc6b31a1b598eb2b4 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.575017:0:16583:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0da00/0xc6b31a1b598eb2b4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.575023:0:16583:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0c84d0da00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740557.575027:0:16583:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0da00/0xc6b31a1b598eb2b4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.575035:0:16583:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0da00/0xc6b31a1b598eb2b4 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.575043:0:16583:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f0d98cd3000) 00010000:00010000:2.0:1790740557.575046:0:16583:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740557.575050:0:16583:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0da00/0xc6b31a1b598eb2b4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.575055:0:16583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0da00/0xc6b31a1b598eb2b4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.575064:0:16583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0de00/0xc6b31a1b598eb2bb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd9fec560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.575070:0:16583:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0de00/0xc6b31a1b598eb2bb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd9fec560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.575076:0:16583:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0de00/0xc6b31a1b598eb2bb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd9fec560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.575088:0:16583:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0c84d0de00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740557.575092:0:16583:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0de00/0xc6b31a1b598eb2bb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd9fec560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.575098:0:16583:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0de00/0xc6b31a1b598eb2bb lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd9fec560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.575106:0:16583:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd9fec560 (ffff8f0d98cd3b00) 00010000:00010000:2.0:1790740557.575108:0:16583:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790740557.575111:0:16583:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0de00/0xc6b31a1b598eb2bb lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd9fec560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.575118:0:16583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0de00/0xc6b31a1b598eb2bb lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd9fec560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740557.575209:0:16583:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8498ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:94f64522-bacd-439b-9eb0-785368ef5e14+25:14526:x1877727133166080:12345-192.168.203.58@tcp:36:lhsmtool_posix.0 Request processed in 593us (790us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790740557.575217:0:16583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 51 00000100:00100000:3.0:1790740557.590970:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740557.591694:0:14357:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133166208 00000100:00100000:0.0:1790740557.591705:0:14357:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133166208 00000100:00100000:0.0:1790740557.591764:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 52 00000100:00100000:0.0:1790740557.591774:0:14357:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8498e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:94f64522-bacd-439b-9eb0-785368ef5e14+25:14526:x1877727133166208:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790740557.591793:0:14357:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740557.591814:0:14357:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598eb2c2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee963 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.591848:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e000/0xc6b31a1b598eb2c9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.591877:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e000/0xc6b31a1b598eb2c9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.591888:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e000/0xc6b31a1b598eb2c9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.591980:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598eb2c2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee963 expref: 27 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.591999:0:14357:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e000/0xc6b31a1b598eb2c9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee963 expref: 26 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.592007:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f0d84bf8c00) 00010000:00010000:0.0:1790740557.592010:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790740557.592013:0:14357:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0dc132e000, rc 0) 00000100:00100000:0.0:1790740557.592069:0:14357:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8498e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:94f64522-bacd-439b-9eb0-785368ef5e14+26:14526:x1877727133166208:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 Request processed in 297us (1108us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740557.592076:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 52 00000100:00100000:3.0:1790740557.598483:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740557.600276:0:16583:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133166464 00000100:00100000:2.0:1790740557.600293:0:16583:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133166464 00000100:00100000:2.0:1790740557.600466:0:16583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 53 00000100:00100000:2.0:1790740557.600479:0:16583:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8498d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:94f64522-bacd-439b-9eb0-785368ef5e14+26:14526:x1877727133166464:12345-192.168.203.58@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790740557.600562:0:16583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0de00/0xc6b31a1b598eb2d0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.600607:0:16583:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0de00/0xc6b31a1b598eb2d0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.600619:0:16583:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0de00/0xc6b31a1b598eb2d0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790740557.601358:0:16583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:2.0:1790740557.601371:0:16583:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 473551797501ns, next at 474551795341ns, rc = 0 00000004:00010000:2.0:1790740557.601457:0:16583:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f3ada2d3 reply state 0000000030b334d1 transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0de00/0xc6b31a1b598eb2d0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740557.601467:0:16583:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790740557.601569:0:16583:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8498d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:94f64522-bacd-439b-9eb0-785368ef5e14+28:14526:x1877727133166464:12345-192.168.203.58@tcp:36:lhsmtool_posix.0 Request processed in 1091us (3092us total) trans 8589934621 rc 0/0 00000100:00100000:2.0:1790740557.601604:0:16583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 53 00010000:00010000:2.0:1790740557.605554:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0de00/0xc6b31a1b598eb2d0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.605653:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0de00/0xc6b31a1b598eb2d0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.605663:0:3289:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0de00/0xc6b31a1b598eb2d0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.605669:0:3289:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0c84d0de00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1790740557.605674:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0de00/0xc6b31a1b598eb2d0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.605682:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0de00/0xc6b31a1b598eb2d0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.605697:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f0d84bf8c00) 00010000:00010000:2.0:1790740557.605700:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790740557.605704:0:3289:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0de00/0xc6b31a1b598eb2d0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.605728:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0de00/0xc6b31a1b598eb2d0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740557.611741:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740557.612664:0:14357:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133166592 00000100:00100000:0.0:1790740557.612674:0:14357:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133166592 00000100:00100000:0.0:1790740557.612738:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 54 00000100:00100000:0.0:1790740557.612748:0:14357:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0d8498ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:94f64522-bacd-439b-9eb0-785368ef5e14+27:14526:x1877727133166592:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790740557.612772:0:14357:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740557.612791:0:14357:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598eb2d7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee96a expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.612847:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598eb2d7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee96a expref: 28 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.612874:0:14357:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598eb2d7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee96a expref: 28 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.612895:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f0d84bf8c00) 00010000:00010000:0.0:1790740557.612898:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790740557.612901:0:14357:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0dc132ee00, rc 0) 00000100:00100000:0.0:1790740557.612966:0:14357:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0d8498ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:94f64522-bacd-439b-9eb0-785368ef5e14+28:14526:x1877727133166592:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 Request processed in 220us (1234us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740557.612974:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 54 00000100:00100000:3.0:1790740557.616996:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740557.617300:0:16022:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133166720 00000100:00100000:2.0:1790740557.617310:0:16022:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133166720 00000100:00100000:2.0:1790740557.617380:0:16022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 12 00000100:00100000:2.0:1790740557.617390:0:16022:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:94f64522-bacd-439b-9eb0-785368ef5e14+5:2370:x1877727133166720:12345-192.168.203.58@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1790740557.617758:0:16022:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:94f64522-bacd-439b-9eb0-785368ef5e14+6:2370:x1877727133166720:12345-192.168.203.58@tcp:2:lhsmtool_posix.0 Request processed in 369us (769us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1790740557.617765:0:16022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 12 00000100:00080000:3.0:1790740557.617931:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790740557.629781:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740557.630107:0:14360:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133166976 00000100:00100000:2.0:1790740557.630117:0:14360:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133166976 00000100:00100000:2.0:1790740557.630232:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 11 00000100:00100000:2.0:1790740557.630243:0:14360:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1c3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:94f64522-bacd-439b-9eb0-785368ef5e14+28:14526:x1877727133166976:12345-192.168.203.58@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790740557.630481:0:14360:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1c3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:94f64522-bacd-439b-9eb0-785368ef5e14+29:14526:x1877727133166976:12345-192.168.203.58@tcp:35:lhsmtool_posix.0 Request processed in 239us (710us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1790740557.630488:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 11 00000100:00100000:1.0:1790740557.636836:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740557.637340:0:14356:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133167232 00000100:00100000:2.0:1790740557.637350:0:14356:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133167232 00000100:00100000:2.0:1790740557.637415:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 55 00000100:00100000:2.0:1790740557.637425:0:14356:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:94f64522-bacd-439b-9eb0-785368ef5e14+29:14526:x1877727133167232:12345-192.168.203.58@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1790740557.637535:0:14356:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:94f64522-bacd-439b-9eb0-785368ef5e14+29:14526:x1877727133167232:12345-192.168.203.58@tcp:57:lhsmtool_posix.0 Request processed in 112us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740557.637542:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 55 00000100:00100000:3.0:1790740557.641103:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740557.641425:0:14357:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133167360 00000100:00100000:0.0:1790740557.641434:0:14357:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133167360 00000100:00100000:0.0:1790740557.641488:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 56 00000100:00100000:0.0:1790740557.641499:0:14357:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1c3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:94f64522-bacd-439b-9eb0-785368ef5e14+29:14526:x1877727133167360:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790740557.641518:0:14357:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790740557.641538:0:14357:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f400/0xc6b31a1b598eb2de lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee971 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.641802:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6a00/0xc6b31a1b598eb2e5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.641817:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6a00/0xc6b31a1b598eb2e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.641828:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6a00/0xc6b31a1b598eb2e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790740557.641863:0:14357:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790740557.641899:0:14357:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6a00/0xc6b31a1b598eb2e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.641924:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132f400/0xc6b31a1b598eb2de lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee971 expref: 31 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.642305:0:14357:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6a00/0xc6b31a1b598eb2e5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee971 expref: 30 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.642316:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f0d84bf8c00) 00010000:00010000:0.0:1790740557.642319:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1790740557.642323:0:14357:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9fea6a00, rc 0) 00000100:00100000:0.0:1790740557.642501:0:14357:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1c3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:94f64522-bacd-439b-9eb0-785368ef5e14+30:14526:x1877727133167360:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 Request processed in 1004us (1405us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740557.642509:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 56 00000100:00100000:2.0:1790740557.648886:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740557.648976:0:15041:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133167488 00000100:00100000:3.0:1790740557.648986:0:15041:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133167488 00000100:00100000:3.0:1790740557.649067:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 13 00000100:00100000:3.0:1790740557.649077:0:15041:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0c86431500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:94f64522-bacd-439b-9eb0-785368ef5e14+6:2370:x1877727133167488:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790740557.649095:0:15041:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740557.649116:0:15041:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf8135ce/0xc6b31a1b598eb2ec lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee978 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790740557.649170:0:15041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abc884d, blocks: 0x1 00010000:00010000:3.0:1790740557.649192:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1790740557.649196:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790740557.649204:0:15041:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf8135ce/0xc6b31a1b598eb2ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee978 expref: 7 pid: 15041 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740557.649224:0:15041:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cf8135ce/0xc6b31a1b598eb2ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee978 expref: 7 pid: 15041 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740557.649237:0:15041:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0db6c0f000, rc 0) 00000100:00100000:3.0:1790740557.649297:0:15041:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0c86431500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:94f64522-bacd-439b-9eb0-785368ef5e14+7:2370:x1877727133167488:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 Request processed in 222us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740557.649305:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 13 00000100:00100000:1.0:1790740557.660225:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740557.660296:0:14356:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133167744 00000100:00100000:3.0:1790740557.660306:0:14356:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133167744 00000100:00100000:3.0:1790740557.660435:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 57 00000100:00100000:3.0:1790740557.660445:0:14356:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:94f64522-bacd-439b-9eb0-785368ef5e14+30:14526:x1877727133167744:12345-192.168.203.58@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790740557.660541:0:14356:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:94f64522-bacd-439b-9eb0-785368ef5e14+30:14526:x1877727133167744:12345-192.168.203.58@tcp:57:lhsmtool_posix.0 Request processed in 98us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740557.660549:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 57 00000100:00100000:1.0:1790740557.665322:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740557.665479:0:14358:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133167872 00000100:00100000:0.0:1790740557.665489:0:14358:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133167872 00000100:00100000:0.0:1790740557.665764:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 58 00000100:00100000:2.0:1790740557.665823:0:14358:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:94f64522-bacd-439b-9eb0-785368ef5e14+30:14526:x1877727133167872:12345-192.168.203.58@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1790740557.711136:0:5865:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934619 is committed 00000001:00080000:0.0:1790740557.711169:0:5865:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934620 is committed 00000001:00080000:0.0:1790740557.711182:0:5865:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000004:00080000:0.0:1790740557.711188:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:1.0:1790740557.711377:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790740557.711395:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158314112:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1790740557.711463:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790740557.711542:0:16022:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158314112 00000100:00100000:1.0:1790740557.711549:0:16022:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158314112 00000100:00100000:1.0:1790740557.711631:0:16022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790740557.711639:0:16022:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158314112:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1790740557.711858:0:16022:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1790740557.711862:0:16022:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1790740557.711864:0:16022:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1790740557.711867:0:16022:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1790740557 -> 1790740557 00002000:00010000:1.0:1790740557.711882:0:16022:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1790740557.711925:0:16022:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3304:x1877727158314112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 287us (462us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1790740557.711933:0:16022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1790740557.712142:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1790740557.712186:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f0dbda71500/2, rc 0, transno 8589934595 00000100:00100000:1.0:1790740557.712192:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158314112:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1790740557.712491:0:14358:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:94f64522-bacd-439b-9eb0-785368ef5e14+13:14526:x1877727133167872:12345-192.168.203.58@tcp:44:lhsmtool_posix.0 Request processed in 46716us (47176us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740557.712501:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 58 00000100:00100000:0.0:1790740557.715796:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740557.715877:0:15044:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133168000 00000100:00100000:3.0:1790740557.715899:0:15044:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133168000 00000100:00100000:3.0:1790740557.716140:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 15 00000100:00100000:3.0:1790740557.716151:0:15044:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd86ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:94f64522-bacd-439b-9eb0-785368ef5e14+7:2369:x1877727133168000:12345-192.168.203.58@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1790740557.716266:0:15044:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd86ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:94f64522-bacd-439b-9eb0-785368ef5e14+7:2369:x1877727133168000:12345-192.168.203.58@tcp:16:lhsmtool_posix.0 Request processed in 117us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740557.716273:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 15 00000100:00100000:1.0:1790740557.720852:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740557.720998:0:16583:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133168256 00000100:00100000:2.0:1790740557.721008:0:16583:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133168256 00000100:00100000:2.0:1790740557.721167:0:16583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 59 00000100:00100000:2.0:1790740557.721179:0:16583:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:94f64522-bacd-439b-9eb0-785368ef5e14+13:14526:x1877727133168256:12345-192.168.203.58@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790740557.721232:0:16583:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790740557.721258:0:16583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea6a00/0xc6b31a1b598eb2e5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee971 expref: 13 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.721276:0:16583:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f0d84bf8c00) 00010000:00010000:2.0:1790740557.721281:0:16583:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790740557.721309:0:16583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0de00/0xc6b31a1b598eb2f3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.721322:0:16583:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0de00/0xc6b31a1b598eb2f3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.721331:0:16583:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0de00/0xc6b31a1b598eb2f3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790740557.721513:0:16583:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000231223a0 reply state 00000000bc88516a transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0de00/0xc6b31a1b598eb2f3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740557.721522:0:16583:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790740557.721835:0:16583:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:94f64522-bacd-439b-9eb0-785368ef5e14+14:14526:x1877727133168256:12345-192.168.203.58@tcp:36:lhsmtool_posix.0 Request processed in 658us (989us total) trans 8589934623 rc 0/0 00000100:00100000:2.0:1790740557.721844:0:16583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 59 00000100:00100000:1.0:1790740557.724542:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00010000:00010000:1.0:1790740557.724626:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0de00/0xc6b31a1b598eb2f3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740557.724637:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0de00/0xc6b31a1b598eb2f3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740557.724645:0:3290:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0de00/0xc6b31a1b598eb2f3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740557.724650:0:3290:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0c84d0de00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1790740557.724655:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0de00/0xc6b31a1b598eb2f3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740557.724662:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0de00/0xc6b31a1b598eb2f3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740557.724678:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f0d84bf8c00) 00010000:00010000:1.0:1790740557.724681:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790740557.724690:0:3290:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0de00/0xc6b31a1b598eb2f3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740557.724697:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0de00/0xc6b31a1b598eb2f3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16583 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740557.724742:0:16022:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133168384 00000100:00100000:1.0:1790740557.724750:0:16022:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133168384 00000100:00100000:1.0:1790740557.724796:0:16022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 16 00000100:00100000:1.0:1790740557.724806:0:16022:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:94f64522-bacd-439b-9eb0-785368ef5e14+7:14526:x1877727133168384:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790740557.724823:0:16022:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790740557.724838:0:16022:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000058ae3d6/0xc6b31a1b598eb2fa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee97f expref: -99 pid: 16022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740557.724867:0:16022:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cf8135ce/0xc6b31a1b598eb2ec lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee978 expref: 8 pid: 15041 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740557.724876:0:16022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790740557.724879:0:16022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790740557.724885:0:16022:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000058ae3d6/0xc6b31a1b598eb2fa lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee97f expref: 8 pid: 16022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740557.724917:0:16022:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cf8135ce/0xc6b31a1b598eb2ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee978 expref: 8 pid: 15041 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740557.724931:0:16022:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cf8135ce/0xc6b31a1b598eb2ec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee978 expref: 8 pid: 15041 timeout: 573 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740557.724946:0:16022:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda71180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:16022:1877727158314240:192.168.203.58@tcp:104: 00000100:00100000:1.0:1790740557.725029:0:16022:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d875736c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790740557.728458:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740557.728487:0:14341:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133168512 00000100:00100000:1.0:1790740557.728495:0:14341:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133168512 00010000:00010000:1.0:1790740557.728534:0:14341:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cf8135ce/0xc6b31a1b598eb2ec lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee978 expref: 9 pid: 15041 timeout: 573 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740557.729235:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 14 00000100:00100000:1.0:1790740557.729297:0:14341:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:94f64522-bacd-439b-9eb0-785368ef5e14+9:2369:x1877727133168512:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790740557.729314:0:14341:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790740557.729335:0:14341:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cf8135ce/0xc6b31a1b598eb2ec lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee978 expref: 9 pid: 15041 timeout: 573 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740557.729351:0:14341:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cf8135ce/0xc6b31a1b598eb2ec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee978 expref: 9 pid: 15041 timeout: 573 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740557.729378:0:14341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790740557.729382:0:14341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790740557.729389:0:14341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000058ae3d6/0xc6b31a1b598eb2fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee97f expref: 9 pid: 16022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740557.729398:0:14341:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000058ae3d6/0xc6b31a1b598eb2fa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee97f expref: 9 pid: 16022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740557.729436:0:14341:0:(ldlm_lockd.c:1085:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000058ae3d6/0xc6b31a1b598eb2fa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee97f expref: 9 pid: 16022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740557.729468:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbda70380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:14341:1877727158314368:192.168.203.58@tcp:105: 00010000:00010000:3.0:1790740557.729767:0:16022:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf8135ce/0xc6b31a1b598eb2ec lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee978 expref: 9 pid: 15041 timeout: 573 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740557.729785:0:16022:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda71180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:16022:1877727158314240:192.168.203.58@tcp:104: 00010000:00010000:3.0:1790740557.729808:0:16022:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000058ae3d6/0xc6b31a1b598eb2fa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee97f expref: 8 pid: 16022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740557.729818:0:16022:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0d9f977600, rc 0) 00000100:00100000:3.0:1790740557.729846:0:16022:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:94f64522-bacd-439b-9eb0-785368ef5e14+8:14526:x1877727133168384:12345-192.168.203.58@tcp:101:lhsmtool_posix.0 Request processed in 5042us (5314us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740557.729856:0:16022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 16 00000100:00100000:1.0:1790740557.730027:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d87573180 going to sleep for 11 seconds 00000100:00100000:1.0:1790740557.733393:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740557.733462:0:15041:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133168640 00000100:00100000:0.0:1790740557.733471:0:15041:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133168640 00000100:00100000:0.0:1790740557.733518:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 17 00000100:00100000:0.0:1790740557.733527:0:15041:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:94f64522-bacd-439b-9eb0-785368ef5e14+8:2370:x1877727133168640:12345-192.168.203.58@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1790740557.733750:0:15041:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1790740557.733754:0:15041:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1790740557 00002000:00010000:0.0:1790740557.733768:0:15041:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1790740555 00002000:00010000:0.0:1790740557.733770:0:15041:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1790740557 -> 1790740557 00002000:00010000:0.0:1790740557.733773:0:15041:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1790740557.733824:0:15041:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:94f64522-bacd-439b-9eb0-785368ef5e14+9:2370:x1877727133168640:12345-192.168.203.58@tcp:2:lhsmtool_posix.0 Request processed in 297us (439us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1790740557.733833:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 17 00000100:00100000:2.0:1790740557.736137:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbda70380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:14341:1877727158314368:192.168.203.58@tcp:105: 00010000:00010000:2.0:1790740557.736190:0:14341:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790740557.736245:0:14341:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:94f64522-bacd-439b-9eb0-785368ef5e14+8:2369:x1877727133168512:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 6998us (7798us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740557.736262:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 14 00000100:00100000:1.0:1790740557.738548:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740557.738709:0:15043:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133168768 00000100:00100000:2.0:1790740557.738719:0:15043:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133168768 00000100:00100000:2.0:1790740557.738775:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 18 00000100:00100000:2.0:1790740557.738785:0:15043:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:94f64522-bacd-439b-9eb0-785368ef5e14+8:2369:x1877727133168768:12345-192.168.203.58@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1790740557.738828:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000045746577/0xc6b31a1b598eb301 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.738849:0:15043:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000058ae3d6/0xc6b31a1b598eb2fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee97f expref: 8 pid: 16022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.738858:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790740557.738862:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790740557.738867:0:15043:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045746577/0xc6b31a1b598eb301 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.738901:0:15043:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000058ae3d6/0xc6b31a1b598eb2fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee97f expref: 8 pid: 16022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.738916:0:15043:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000058ae3d6/0xc6b31a1b598eb2fa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee97f expref: 8 pid: 16022 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740557.738930:0:15043:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0c86433480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15043:1877727158314496:192.168.203.58@tcp:104: 00000100:00100000:2.0:1790740557.739840:0:15043:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d817a83c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790740557.743219:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740557.743320:0:15043:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0c86433480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15043:1877727158314496:192.168.203.58@tcp:104: 00010000:00010000:2.0:1790740557.743346:0:15043:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000045746577/0xc6b31a1b598eb301 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740557.743472:0:14343:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133168896 00000100:00100000:3.0:1790740557.743479:0:14343:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133168896 00010000:00010000:3.0:1790740557.743515:0:14343:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000058ae3d6/0xc6b31a1b598eb2fa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee97f expref: 9 pid: 16022 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740557.743606:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 15 00000100:00100000:3.0:1790740557.743615:0:14343:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:94f64522-bacd-439b-9eb0-785368ef5e14+9:2370:x1877727133168896:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790740557.743631:0:14343:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740557.743663:0:14343:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000058ae3d6/0xc6b31a1b598eb2fa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee97f expref: 9 pid: 16022 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740557.743676:0:14343:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000058ae3d6/0xc6b31a1b598eb2fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee97f expref: 9 pid: 16022 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740557.743705:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000058ae3d6/0xc6b31a1b598eb2fa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee97f expref: 9 pid: 16022 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740557.743721:0:14343:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790740557.743725:0:14343:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790740557.743731:0:14343:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000045746577/0xc6b31a1b598eb301 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740557.743741:0:14343:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045746577/0xc6b31a1b598eb301 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740557.743769:0:14343:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790740557.743812:0:14343:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:94f64522-bacd-439b-9eb0-785368ef5e14+8:2370:x1877727133168896:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 199us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740557.743820:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 15 00010000:00010000:2.0:1790740557.743869:0:15043:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000045746577/0xc6b31a1b598eb301 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.743878:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045746577/0xc6b31a1b598eb301 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.743901:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000045746577/0xc6b31a1b598eb301 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.743909:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000045746577/0xc6b31a1b598eb301 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.743917:0:15043:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000045746577/0xc6b31a1b598eb301 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.743923:0:15043:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0c84d0da00 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:2.0:1790740557.743928:0:15043:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000045746577/0xc6b31a1b598eb301 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.743936:0:15043:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000045746577/0xc6b31a1b598eb301 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.743959:0:15043:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000045746577/0xc6b31a1b598eb301 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.743967:0:15043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045746577/0xc6b31a1b598eb301 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790740557.744004:0:15043:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:94f64522-bacd-439b-9eb0-785368ef5e14+7:2369:x1877727133168768:12345-192.168.203.58@tcp:1:lhsmtool_posix.0 Request processed in 5221us (5463us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740557.744011:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 18 00000100:00100000:1.0:1790740557.748859:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740557.748929:0:14357:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133169152 00000100:00100000:3.0:1790740557.748948:0:14357:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133169152 00000100:00100000:3.0:1790740557.749004:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 60 00000100:00100000:3.0:1790740557.749013:0:14357:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db57a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:94f64522-bacd-439b-9eb0-785368ef5e14+13:14526:x1877727133169152:12345-192.168.203.58@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1790740557.749090:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598eb308 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740557.749120:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598eb308 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740557.749132:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598eb308 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740557.749372:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ec00/0xc6b31a1b598eb30f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740557.749385:0:14357:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598eb2d7 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee96a expref: 14 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740557.749393:0:14357:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ec00/0xc6b31a1b598eb30f lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740557.749427:0:14357:0:(ldlm_lockd.c:966:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598eb2d7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee96a expref: 14 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740557.749441:0:14357:0:(ldlm_lockd.c:498:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598eb2d7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee96a expref: 14 pid: 14357 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740557.749455:0:14357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dc1c3c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14357:1877727158314624:192.168.203.58@tcp:104: 00000100:00100000:3.0:1790740557.749551:0:14357:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0d81324540 going to sleep for 11 seconds 00000100:00100000:3.0:1790740557.751872:0:14357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dc1c3c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14357:1877727158314624:192.168.203.58@tcp:104: 00010000:00010000:3.0:1790740557.751900:0:14357:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ec00/0xc6b31a1b598eb30f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790740557.753281:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740557.753540:0:14341:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133169280 00000100:00100000:3.0:1790740557.753562:0:14341:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133169280 00010000:00010000:3.0:1790740557.753634:0:14341:0:(ldlm_lockd.c:2686:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598eb2d7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee96a expref: 15 pid: 14357 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790740557.753669:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 16 00000100:00100000:3.0:1790740557.753678:0:14341:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db57aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:94f64522-bacd-439b-9eb0-785368ef5e14+15:2369:x1877727133169280:12345-192.168.203.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790740557.753702:0:14341:0:(ldlm_lockd.c:1750:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790740557.753709:0:14341:0:(ldlm_lockd.c:1799:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598eb2d7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee96a expref: 15 pid: 14357 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740557.753722:0:14341:0:(ldlm_lockd.c:571:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598eb2d7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee96a expref: 15 pid: 14357 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740557.753742:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132ee00/0xc6b31a1b598eb2d7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee96a expref: 15 pid: 14357 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740557.753756:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f0d84bf8c00) 00010000:00010000:3.0:1790740557.753761:0:14341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ec00/0xc6b31a1b598eb30f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740557.753770:0:14341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ec00/0xc6b31a1b598eb30f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740557.753778:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ec00/0xc6b31a1b598eb30f lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740557.753798:0:14341:0:(ldlm_lockd.c:1811:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790740557.753842:0:14341:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db57aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:94f64522-bacd-439b-9eb0-785368ef5e14+14:2369:x1877727133169280:12345-192.168.203.58@tcp:103:ldlm_bl.0 Request processed in 165us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740557.753860:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 16 00010000:00010000:0.0:1790740557.753971:0:14357:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ec00/0xc6b31a1b598eb30f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.753979:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ec00/0xc6b31a1b598eb30f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790740557.754128:0:14357:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:0.0:1790740557.754275:0:14357:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:0.0:1790740557.754322:0:14357:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:0.0:1790740557.754396:0:14357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd86e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14357:1877727158314752:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1790740557.754443:0:14357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740557.754472:0:14357:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0db6f3b180 going to sleep for 11 seconds 00000100:00100000:3.0:1790740557.755022:0:14361:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158314752 00000100:00100000:3.0:1790740557.755031:0:14361:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158314752 00000100:00100000:3.0:1790740557.755076:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790740557.755083:0:14361:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd86f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14357:x1877727158314752:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1790740557.755153:0:14361:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd86f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14357:x1877727158314752:12345-0@lo:1000:mdt00_001.0 Request processed in 71us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740557.755170:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790740557.757817:0:14357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd86e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14357:1877727158314752:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1790740557.758527:0:14357:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:0.0:1790740557.758646:0:14357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd86e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14357:1877727158314880:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1790740557.758712:0:14357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740557.758746:0:14357:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0db6f3ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1790740557.758923:0:14361:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158314880 00000100:00100000:3.0:1790740557.758931:0:14361:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158314880 00000100:00100000:3.0:1790740557.758982:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790740557.758992:0:14361:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd86fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14357:x1877727158314880:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1790740557.759170:0:14361:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd86fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14357:x1877727158314880:12345-0@lo:1000:mdt00_001.0 Request processed in 178us (457us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1790740557.759178:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790740557.759422:0:14357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd86e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14357:1877727158314880:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1790740557.759457:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ec00/0xc6b31a1b598eb30f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.759468:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ec00/0xc6b31a1b598eb30f lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.759484:0:14357:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ec00/0xc6b31a1b598eb30f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.759490:0:14357:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0ec00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1790740557.759495:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ec00/0xc6b31a1b598eb30f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.759503:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ec00/0xc6b31a1b598eb30f lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.759517:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f0d84bf8c00) 00010000:00010000:0.0:1790740557.759520:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790740557.759525:0:14357:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ec00/0xc6b31a1b598eb30f lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.759531:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0ec00/0xc6b31a1b598eb30f lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.759557:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598eb267 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.759564:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598eb267 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.759569:0:14357:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598eb267 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.759607:0:14357:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0dc132e600 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1790740557.759611:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598eb267 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.759628:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598eb267 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.759637:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f0d84bf8300) 00010000:00010000:0.0:1790740557.759639:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790740557.759645:0:14357:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976a00/0xc6b31a1b598eb26e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee94e expref: 17 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.759656:0:14357:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976a00/0xc6b31a1b598eb26e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee94e expref: 17 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.759665:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976a00/0xc6b31a1b598eb26e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee94e expref: 17 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.759693:0:14357:0:(ldlm_lockd.c:1085:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9f976a00/0xc6b31a1b598eb26e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee94e expref: 17 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740557.759706:0:14357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd86d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14357:1877727158315008:192.168.203.58@tcp:105: 00000100:00100000:0.0:1790740557.759830:0:14357:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f0db6f3ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1790740557.767422:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740557.767590:0:14357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd86d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14357:1877727158315008:192.168.203.58@tcp:105: 00010000:00010000:0.0:1790740557.767620:0:14357:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598eb267 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.767632:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0dc132e600/0xc6b31a1b598eb267 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.767664:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea7600/0xc6b31a1b598eb316 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.767691:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea7600/0xc6b31a1b598eb316 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.767703:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea7600/0xc6b31a1b598eb316 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.767714:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea7600/0xc6b31a1b598eb316 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.767721:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea7600/0xc6b31a1b598eb316 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.767728:0:14357:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea7600/0xc6b31a1b598eb316 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.767735:0:14357:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9fea7600 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1790740557.767739:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea7600/0xc6b31a1b598eb316 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.767746:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea7600/0xc6b31a1b598eb316 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.767757:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f0d84bf8300) 00010000:00010000:0.0:1790740557.767760:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740557.767764:0:14357:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea7600/0xc6b31a1b598eb316 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.767769:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea7600/0xc6b31a1b598eb316 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.767778:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598eb308 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.767791:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598eb308 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.767797:0:14357:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598eb308 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.767801:0:14357:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0db6c0f000 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1790740557.767804:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598eb308 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.767810:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598eb308 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.767819:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f0d84bf8300) 00010000:00010000:0.0:1790740557.767821:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790740557.767824:0:14357:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598eb308 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.767828:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0f000/0xc6b31a1b598eb308 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740557.768056:0:14357:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db57a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:94f64522-bacd-439b-9eb0-785368ef5e14+17:14526:x1877727133169152:12345-192.168.203.58@tcp:57:lhsmtool_posix.0 Request processed in 19043us (19492us total) trans 8589934628 rc 0/0 00000100:00100000:0.0:1790740557.768067:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 60 00000020:00080000:0.0:1790740557.768073:0:14357:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1790740557.768287:0:14359:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133169408 00000100:00100000:2.0:1790740557.768295:0:14359:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133169408 00000100:00100000:2.0:1790740557.768336:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 12 00000100:00100000:2.0:1790740557.768345:0:14359:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db57a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:94f64522-bacd-439b-9eb0-785368ef5e14+17:14525:x1877727133169408:12345-192.168.203.58@tcp:49:bash.0 00000100:00100000:2.0:1790740557.768445:0:14359:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db57a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:94f64522-bacd-439b-9eb0-785368ef5e14+17:14525:x1877727133169408:12345-192.168.203.58@tcp:49:bash.0 Request processed in 101us (1042us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740557.768452:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 12 00000040:00080000:3.0:1790740557.772026:0:14391:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1790740557.772035:0:14391:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790740557.772067:0:14391:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1790740557.772074:0:14391:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1790740557.772389:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740557.772516:0:14359:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133169664 00000100:00100000:2.0:1790740557.772525:0:14359:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133169664 00000100:00100000:2.0:1790740557.772609:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 13 00000100:00100000:2.0:1790740557.772619:0:14359:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db57aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:94f64522-bacd-439b-9eb0-785368ef5e14+17:14526:x1877727133169664:12345-192.168.203.58@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1790740557.774112:0:14359:0:(mdd_object.c:4180:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1790740557.775173:0:14359:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:2.0:1790740557.775254:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0da00/0xc6b31a1b598eb31d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.775284:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0da00/0xc6b31a1b598eb31d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.775296:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0da00/0xc6b31a1b598eb31d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.775305:0:14359:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0da00/0xc6b31a1b598eb31d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.775311:0:14359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0da00/0xc6b31a1b598eb31d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.775318:0:14359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0da00/0xc6b31a1b598eb31d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.775391:0:14359:0:(ldlm_lockd.c:2192:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1790740557.775505:0:14359:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db57aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:94f64522-bacd-439b-9eb0-785368ef5e14+19:14526:x1877727133169664:12345-192.168.203.58@tcp:35:lhsmtool_posix.0 Request processed in 2884us (3116us total) trans 8589934630 rc 0/0 00000100:00100000:2.0:1790740557.775515:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 13 00000020:00080000:2.0:1790740557.775520:0:14359:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1790740557.778392:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740557.779997:0:15041:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133169792 00000100:00100000:2.0:1790740557.780008:0:15041:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133169792 00000100:00100000:2.0:1790740557.780081:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 19 00000100:00100000:2.0:1790740557.780092:0:15041:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1c3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:94f64522-bacd-439b-9eb0-785368ef5e14+7:14525:x1877727133169792:12345-192.168.203.58@tcp:101:bash.0 00010000:00010000:2.0:1790740557.780111:0:15041:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790740557.780132:0:15041:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000baa85378/0xc6b31a1b598eb324 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee986 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790740557.780167:0:15041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6abc884d, atime: 0x6abc884b, ctime: 0x6abc884d, blocks: 0x1 00010000:00010000:2.0:1790740557.780206:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1790740557.780211:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790740557.780220:0:15041:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000baa85378/0xc6b31a1b598eb324 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee986 expref: 8 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.780236:0:15041:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000baa85378/0xc6b31a1b598eb324 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee986 expref: 8 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790740557.780249:0:15041:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0c84d0d000, rc 0) 00000100:00100000:2.0:1790740557.780321:0:15041:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1c3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:94f64522-bacd-439b-9eb0-785368ef5e14+8:14525:x1877727133169792:12345-192.168.203.58@tcp:101:bash.0 Request processed in 230us (1936us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740557.780328:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 19 00000100:00100000:3.0:1790740557.784933:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740557.785025:0:14360:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133170048 00000100:00100000:0.0:1790740557.785034:0:14360:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133170048 00000100:00100000:0.0:1790740557.785088:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 14 00000100:00100000:0.0:1790740557.785096:0:14360:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1c3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:94f64522-bacd-439b-9eb0-785368ef5e14+19:14525:x1877727133170048:12345-192.168.203.58@tcp:35:bash.0 00000001:00080000:0.0:1790740557.785415:0:14360:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934631 00000100:00100000:0.0:1790740557.785525:0:14360:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1c3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:94f64522-bacd-439b-9eb0-785368ef5e14+21:14525:x1877727133170048:12345-192.168.203.58@tcp:35:bash.0 Request processed in 429us (599us total) trans 8589934632 rc 0/0 00000100:00100000:0.0:1790740557.785532:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 14 00000020:00080000:0.0:1790740557.785537:0:14360:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790740557.788241:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790740557.788255:0:14344:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0da00/0xc6b31a1b598eb31d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740557.788268:0:14344:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0c84d0da00 already unused, calling callback (ffffffffc155fac0) 00010000:00010000:1.0:1790740557.788273:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0da00/0xc6b31a1b598eb31d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740557.788284:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0da00/0xc6b31a1b598eb31d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740557.788300:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f0d84bf8c00) 00010000:00010000:1.0:1790740557.788304:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1790740557.788308:0:14344:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0da00/0xc6b31a1b598eb31d lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740557.788314:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0c84d0da00/0xc6b31a1b598eb31d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790740557.788349:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740557.788351:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790740557.788353:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740557.889364:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:3.0:1790740557.889548:0:14356:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133170304 00000100:00100000:3.0:1790740557.889558:0:14356:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133170304 00000100:00100000:3.0:1790740557.889657:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 61 00000100:00100000:3.0:1790740557.889667:0:14356:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd86d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:94f64522-bacd-439b-9eb0-785368ef5e14+21:14536:x1877727133170304:12345-192.168.203.58@tcp:101:lfs.0 00010000:00010000:3.0:1790740557.889699:0:14356:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790740557.889730:0:14356:0:(ldlm_lockd.c:1346:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fc00/0xc6b31a1b598eb32b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6415c98cf5cee98d expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790740557.889818:0:14356:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1790740557.889929:0:14356:0:(ldlm_lockd.c:1516:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fc00/0xc6b31a1b598eb32b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee98d expref: 23 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740557.889942:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0d84bf8d00) 00010000:00010000:3.0:1790740557.889945:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790740557.889950:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0db6c0fc00/0xc6b31a1b598eb32b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.58@tcp remote: 0x6415c98cf5cee98d expref: 23 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790740557.889963:0:14356:0:(ldlm_lockd.c:1595:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0db6c0fc00, rc 0) 00000100:00100000:3.0:1790740557.890132:0:14356:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd86d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:94f64522-bacd-439b-9eb0-785368ef5e14+22:14536:x1877727133170304:12345-192.168.203.58@tcp:101:lfs.0 Request processed in 466us (777us total) trans 8589934633 rc 301/301 00000100:00100000:3.0:1790740557.890139:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 61 00000100:00100000:3.0:1790740557.894285:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:0.0:1790740557.894373:0:14358:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133170432 00000100:00100000:0.0:1790740557.894383:0:14358:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133170432 00000100:00100000:0.0:1790740557.894442:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 62 00000100:00100000:0.0:1790740557.894451:0:14358:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1c3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:94f64522-bacd-439b-9eb0-785368ef5e14+22:14536:x1877727133170432:12345-192.168.203.58@tcp:34:lfs.0 00010000:00010000:0.0:1790740557.894524:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea7000/0xc6b31a1b598eb339 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.894541:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea7000/0xc6b31a1b598eb339 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.894553:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea7000/0xc6b31a1b598eb339 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.894567:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea7800/0xc6b31a1b598eb340 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.894619:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea7800/0xc6b31a1b598eb340 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.894626:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea7800/0xc6b31a1b598eb340 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.894982:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea7400/0xc6b31a1b598eb347 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.895003:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea7400/0xc6b31a1b598eb347 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.895010:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea7400/0xc6b31a1b598eb347 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790740557.895049:0:14358:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea7400/0xc6b31a1b598eb347 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.895061:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea7000/0xc6b31a1b598eb339 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.895068:0:14358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea7000/0xc6b31a1b598eb339 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.895075:0:14358:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea7000/0xc6b31a1b598eb339 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.895080:0:14358:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9fea7000 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1790740557.895084:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea7000/0xc6b31a1b598eb339 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.895091:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea7000/0xc6b31a1b598eb339 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.895102:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f0d98cd3000) 00010000:00010000:0.0:1790740557.895105:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740557.895110:0:14358:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea7000/0xc6b31a1b598eb339 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.895117:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea7000/0xc6b31a1b598eb339 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.895135:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea7800/0xc6b31a1b598eb340 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.895141:0:14358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea7800/0xc6b31a1b598eb340 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.895146:0:14358:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea7800/0xc6b31a1b598eb340 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.895151:0:14358:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9fea7800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1790740557.895154:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea7800/0xc6b31a1b598eb340 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.895172:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea7800/0xc6b31a1b598eb340 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.895180:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8f0d98dcce00) 00010000:00010000:0.0:1790740557.895182:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740557.895185:0:14358:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea7800/0xc6b31a1b598eb340 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.895191:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea7800/0xc6b31a1b598eb340 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.895206:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea7400/0xc6b31a1b598eb347 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.895213:0:14358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea7400/0xc6b31a1b598eb347 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.895219:0:14358:0:(ldlm_lockd.c:1910:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea7400/0xc6b31a1b598eb347 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.895230:0:14358:0:(ldlm_lockd.c:1924:ldlm_handle_bl_callback()) Lock ffff8f0d9fea7400 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1790740557.895233:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea7400/0xc6b31a1b598eb347 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.895239:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea7400/0xc6b31a1b598eb347 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.895247:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f0d84bf8300) 00010000:00010000:0.0:1790740557.895249:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790740557.895252:0:14358:0:(ldlm_lockd.c:1936:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea7400/0xc6b31a1b598eb347 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790740557.895258:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0d9fea7400/0xc6b31a1b598eb347 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790740557.895322:0:14358:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1c3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:94f64522-bacd-439b-9eb0-785368ef5e14+22:14536:x1877727133170432:12345-192.168.203.58@tcp:34:lfs.0 Request processed in 871us (1045us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740557.895331:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 62 00000100:00100000:0.0:1790740557.898411:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740557.898568:0:14360:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133170688 00000100:00100000:2.0:1790740557.898615:0:14360:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133170688 00000100:00100000:2.0:1790740557.898670:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 15 00000100:00100000:2.0:1790740557.898680:0:14360:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbd86ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:94f64522-bacd-439b-9eb0-785368ef5e14+22:14536:x1877727133170688:12345-192.168.203.58@tcp:35:lfs.0 00000100:00100000:2.0:1790740557.898966:0:14360:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbd86ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:94f64522-bacd-439b-9eb0-785368ef5e14+23:14536:x1877727133170688:12345-192.168.203.58@tcp:35:lfs.0 Request processed in 286us (563us total) trans 8589934634 rc 0/0 00000100:00100000:2.0:1790740557.898974:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 15 00010000:00010000:3.0:1790740558.129690:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740558.129797:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0c86433480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158315136:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790740558.129868:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790740558.130133:0:15045:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158315136 00000100:00100000:3.0:1790740558.130142:0:15045:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158315136 00000100:00100000:3.0:1790740558.130209:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790740558.130219:0:15045:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db57ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1877727158315136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790740558.130253:0:15045:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790740558.130308:0:15045:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db57ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1877727158315136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740558.130315:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790740558.130397:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0c86433480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158315136:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790740558.737724:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740558.737914:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740558.737953:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740558.737983:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740558.738001:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740558.738023:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740558.738044:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740558.738088:0:14356:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133171328 00000100:00100000:1.0:1790740558.738097:0:14356:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133171328 00000100:00100000:1.0:1790740558.738159:0:14356:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133170944 00000100:00100000:1.0:1790740558.738162:0:14356:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133170944 00000100:00100000:1.0:1790740558.738186:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 30 00000100:00100000:1.0:1790740558.738196:0:14356:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbda76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1afbbc59-4fef-403d-8587-7e85da474903+6:2369:x1877727133171328:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:1.0:1790740558.738260:0:14356:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbda76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1afbbc59-4fef-403d-8587-7e85da474903+6:2369:x1877727133171328:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 66us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740558.738267:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 30 00000100:00100000:1.0:1790740558.738283:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 31 00000100:00100000:1.0:1790740558.738288:0:14356:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:94f64522-bacd-439b-9eb0-785368ef5e14+23:2369:x1877727133170944:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:1.0:1790740558.738310:0:14356:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:94f64522-bacd-439b-9eb0-785368ef5e14+23:2369:x1877727133170944:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 22us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740558.738328:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 31 00000100:00080000:1.0:1790740558.738344:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790740558.738361:0:15044:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133171072 00000100:00100000:1.0:1790740558.738365:0:15044:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133171072 00000100:00100000:1.0:1790740558.738380:0:15044:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133171584 00000100:00100000:1.0:1790740558.738382:0:15044:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133171584 00000100:00100000:1.0:1790740558.738395:0:15044:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133171200 00000100:00100000:1.0:1790740558.738397:0:15044:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133171200 00000100:00100000:1.0:1790740558.738406:0:15044:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133171456 00000100:00100000:1.0:1790740558.738408:0:15044:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133171456 00000100:00100000:1.0:1790740558.738420:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 18 00000100:00100000:1.0:1790740558.738425:0:15044:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db57a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:94f64522-bacd-439b-9eb0-785368ef5e14+8:2369:x1877727133171072:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:1.0:1790740558.738469:0:15044:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db57a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:94f64522-bacd-439b-9eb0-785368ef5e14+8:2369:x1877727133171072:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 42us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740558.738475:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 18 00000100:00100000:1.0:1790740558.738488:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 19 00000100:00100000:1.0:1790740558.738494:0:15044:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1afbbc59-4fef-403d-8587-7e85da474903+5:2369:x1877727133171584:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:1.0:1790740558.738516:0:15044:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1afbbc59-4fef-403d-8587-7e85da474903+5:2369:x1877727133171584:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 23us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1790740558.738521:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 19 00000100:00100000:1.0:1790740558.738531:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 20 00000100:00100000:1.0:1790740558.738536:0:15044:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:94f64522-bacd-439b-9eb0-785368ef5e14+5:2369:x1877727133171200:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:1.0:1790740558.738605:0:15044:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:94f64522-bacd-439b-9eb0-785368ef5e14+5:2369:x1877727133171200:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 68us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740558.738784:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 21 00000100:00100000:2.0:1790740558.738794:0:15043:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1afbbc59-4fef-403d-8587-7e85da474903+5:2369:x1877727133171456:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:2.0:1790740558.738821:0:15043:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1afbbc59-4fef-403d-8587-7e85da474903+5:2369:x1877727133171456:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 30us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740558.738827:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 21 00000100:00080000:0.0:1790740558.739226:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790740558.739230:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790740558.740077:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 20 00000100:00100000:3.0:1790740558.746566:0:14350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133170816 00000100:00100000:3.0:1790740558.746597:0:14350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133170816 00000100:00100000:3.0:1790740558.750012:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 123 00000100:00100000:3.0:1790740558.750022:0:14350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc1328850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dfd6896-73f9-47af-8d09-fc89b7bb7456+13:2369:x1877727133170816:12345-192.168.203.58@tcp:400:kworker.0 00000100:00100000:3.0:1790740558.750143:0:14350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc1328850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dfd6896-73f9-47af-8d09-fc89b7bb7456+13:2369:x1877727133170816:12345-192.168.203.58@tcp:400:kworker.0 Request processed in 121us (12536us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740558.750159:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 123 00010000:00010000:3.0:1790740559.158781:0:15644:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790740559.674205:0:16622:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:1.0:1790740560.177464:0:14344:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790740560.689473:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd86c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158315520:0@lo:400:kworker.0 00000100:00100000:0.0:1790740560.689539:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740560.689632:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790740560.689638:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd7d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877727158315648:0@lo:400:kworker.0 00000100:00100000:0.0:1790740560.689664:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790740560.689698:0:15043:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158315520 00000100:00100000:0.0:1790740560.689705:0:15043:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158315520 00000100:00100000:0.0:1790740560.689766:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790740560.689786:0:15043:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db6dc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158315520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740560.689837:0:15043:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db6dc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1877727158315520:12345-0@lo:400:kworker.0 Request processed in 53us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740560.689844:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790740560.689867:0:14356:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158315648 00000100:00100000:0.0:1790740560.689870:0:14356:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158315648 00000100:00100000:0.0:1790740560.689896:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790740560.689902:0:14356:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db6dc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877727158315648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740560.689931:0:14356:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db6dc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877727158315648:12345-0@lo:400:kworker.0 Request processed in 29us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740560.689937:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1790740560.689953:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790740560.689987:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd7d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877727158315648:0@lo:400:kworker.0 00000100:00100000:0.0:1790740560.689998:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd86c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1877727158315520:0@lo:400:kworker.0 00000100:00100000:2.0:1790740560.690230:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd86ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158315392:0@lo:400:kworker.0 00000100:00100000:2.0:1790740560.690261:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740560.690279:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0db6dc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1877727158315904:0@lo:400:kworker.0 00000100:00100000:2.0:1790740560.690299:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740560.690317:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1790740560.690323:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd86f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:752c79c8-24e4-410a-832f-aac51b94c085:3306:1877727158315264:0@lo:400:kworker.0 00000100:00100000:2.0:1790740560.690347:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740560.690377:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0dbd7d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1877727158315776:0@lo:400:kworker.0 00000100:00100000:2.0:1790740560.690409:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790740560.690433:0:14357:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158315904 00000100:00100000:2.0:1790740560.690437:0:14357:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158315904 00000100:00100000:2.0:1790740560.690461:0:14357:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158315776 00000100:00100000:2.0:1790740560.690464:0:14357:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158315776 00000100:00100000:2.0:1790740560.690481:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790740560.690487:0:14357:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0c86430000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877727158315904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740560.690521:0:14357:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0c86430000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877727158315904:12345-0@lo:400:kworker.0 Request processed in 34us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740560.690527:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790740560.690541:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790740560.690546:0:14357:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0c86433800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877727158315776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790740560.690600:0:14357:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0c86433800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877727158315776:12345-0@lo:400:kworker.0 Request processed in 26us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740560.690607:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790740560.690634:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd7d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1877727158315776:0@lo:400:kworker.0 00000100:00100000:2.0:1790740560.690643:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0db6dc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1877727158315904:0@lo:400:kworker.0 00000100:00100000:3.0:1790740560.690806:0:14349:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158315264 00000100:00100000:3.0:1790740560.690811:0:14349:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158315264 00000100:00100000:3.0:1790740560.690837:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1790740560.690844:0:14349:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dc132a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:752c79c8-24e4-410a-832f-aac51b94c085+19:3306:x1877727158315264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790740560.690880:0:14349:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dc132a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:752c79c8-24e4-410a-832f-aac51b94c085+19:3306:x1877727158315264:12345-0@lo:400:kworker.0 Request processed in 37us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740560.690887:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1790740560.690924:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd86f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:752c79c8-24e4-410a-832f-aac51b94c085:3306:1877727158315264:0@lo:400:kworker.0 00000100:00100000:0.0:1790740560.691365:0:16022:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158315392 00000100:00100000:0.0:1790740560.691370:0:16022:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158315392 00000100:00100000:0.0:1790740560.691410:0:16022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790740560.691418:0:16022:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0c86430a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3306:x1877727158315392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790740560.691456:0:16022:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0c86430a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3306:x1877727158315392:12345-0@lo:400:kworker.0 Request processed in 40us (1195us total) trans 0 rc 0/0 00000100:00100000:0.0:1790740560.691462:0:16022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790740560.691486:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790740560.691496:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f0c86431880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158316032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790740560.691523:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1790740560.691546:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790740560.691557:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790740560.692294:0:15045:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727158316032 00000100:00100000:3.0:1790740560.692302:0:15045:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727158316032 00000100:00100000:3.0:1790740560.692338:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790740560.692346:0:15045:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0db6dc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158316032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790740560.692373:0:15045:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790740560.692434:0:15045:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0db6dc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877727158316032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1790740560.692441:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790740560.692482:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0c86431880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1877727158316032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790740560.692519:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f0dbd86ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1877727158315392:0@lo:400:kworker.0 00010000:00010000:1.0:1790740561.212085:0:14345:0:(ldlm_lockd.c:2807:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790740561.300988:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:1.0:1790740561.301037:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.58@tcp (source: 12345-192.168.203.58@tcp) 00000100:00100000:2.0:1790740561.301192:0:15043:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133171840 00000100:00100000:2.0:1790740561.301202:0:15043:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133171840 00000100:00100000:2.0:1790740561.301272:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 20 00000100:00100000:2.0:1790740561.301281:0:15043:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:94f64522-bacd-439b-9eb0-785368ef5e14+8:2372:x1877727133171840:12345-192.168.203.58@tcp:16:kworker.0 00000100:00100000:2.0:1790740561.301497:0:15043:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:94f64522-bacd-439b-9eb0-785368ef5e14+8:2372:x1877727133171840:12345-192.168.203.58@tcp:16:kworker.0 Request processed in 115us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1790740561.301506:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 20 00000100:00080000:1.0:1790740561.301849:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790740561.302350:0:15047:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877727133171712 00000100:00100000:0.0:1790740561.302358:0:15047:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877727133171712 00002000:00100000:0.0:1790740561.302390:0:15047:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (0->8) req@ffff8f0dbee5c380 x1877727133171712/t0(0) o4->94f64522-bacd-439b-9eb0-785368ef5e14@192.168.203.58@tcp:617/0 lens 504/0 e 0 to 0 dl 1790740572 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1790740561.303090:0:15047:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f0dbee5c380 with x1877727133171712 ext(0->8) 00002000:00010000:0.0:1790740561.303098:0:15047:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f0dbee5c380 00000100:00100000:0.0:1790740561.303143:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.58@tcp, seq: 0 00000100:00100000:0.0:1790740561.303155:0:15047:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0dbee5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:94f64522-bacd-439b-9eb0-785368ef5e14+8:2372:x1877727133171712:12345-192.168.203.58@tcp:4:bash.0 00000100:00100000:0.0:1790740561.308650:0:15047:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0dbee5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:94f64522-bacd-439b-9eb0-785368ef5e14+10:2372:x1877727133171712:12345-192.168.203.58@tcp:4:bash.0 Request processed in 5487us (7660us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1790740561.308665:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.58@tcp, seq: 0 00002000:00100000:0.0:1790740561.308679:0:15047:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (0->8) req@ffff8f0dbee5c380 x1877727133171712/t8589934598(0) o4->94f64522-bacd-439b-9eb0-785368ef5e14@192.168.203.58@tcp:617/0 lens 504/448 e 0 to 0 dl 1790740572 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1790740561.308689:0:15047:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f0dbee5c380 with x1877727133171712 ext(0->8) 00002000:00010000:0.0:1790740561.308697:0:15047:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f0dbee5c380 Debug log: 29592 lines, 29592 kept, 0 dropped, 0 bad.